Red Branch | For Future Reference …
Using the Hadoop command we can send fairly regular filesystem commands to navigate HDFS. On Cloudera I am sending commands to port 8020 of the active name node. If you don’t have the hadoop command available on your system you need to download hadoop, extract it and add the bin directory to your path. For… Read more »
So working on a system that had incorrect partitioning configured. In /etc/fstab the partitions were configured with:
|
1 2 |
PARTLABEL=data1 /data1 ext4 defaults 0 0 PARTLABEL=data2 /data2 ext4 defaults 0 0 |
but the partitions did not have PARTLABELS set. The LABEL and PARTLABEL can be viewed with:
|
1 |
lsblk -o name,label,partlabel,mountpoint,size,uuid |
To set the label property use:
|
1 |
e2label /dev/sdb1 mylabel |
To set the partlabel on a GPT partition first install gdisk:
|
1 |
yum install gdisk |
Then… Read more »
I needed to access the Hue file browser service and for my version of cloudera this was: cd /opt/cloudera/parcels/CDH-5.7.6-1.cdh5.7.6.p0.6/lib/hue Run the createuser command: ./build/env/bin/hue createsuperuser Username (leave blank to use ‘joebloggs’): Email address: joebloggs@whatever.tld Password: Password (again): Superuser created successfully.
Download the latest version of the Arduino IDE as the version in the Ubuntu/Mint/Debian repositories is a little old: https://www.arduino.cc/en/Main/Software At the time of writing I am using version 1.8.5 Configure Arduino IDE First we need to import everything we need to operate the MKR Fox 1200 so first visit Tools > Board > Board… Read more »
Good concise article here on devopscube for installing zookeeper cluster. I’ve added some of my own bits: Firewall Disable firewalld or allow ports 2181 3888 2888 Install Java
|
1 |
yum install java-1.8.0-openjdk |
User Create a zookeeper user
|
1 2 |
groupadd zookeeper useradd -g zookeeper -d /opt/zookeeper -s /sbin/nologin zookeeper |
Install Zookeeper Download ZooKeeper from the Apache:
|
1 2 3 4 5 6 7 8 9 |
wget http://mirrors.ukfast.co.uk/sites/ftp.apache.org/zookeeper/zookeeper-3.4.10/zookeeper-3.4.10.tar.gz mv zookeeper-3.4.10.tar.gz /opt cd /opt tar xzf zookeeper-3.4.10.tar.gz ln -s zookeeper-3.4.10 ./zookeeper cd zookeeper mkdir data |
Set the permissions:
|
1 |
chown -R zookeeper:zookeeper /opt/zookeeper/* |
|
1 |
vi /opt/zookeeper/conf/zoo.cfg |
Add the following:
|
1 2 3 4 5 6 7 8 |
tickTime=2000 initLimit=10 syncLimit=5 dataDir=/opt/zookeeper/data clientPort=2181 server.1=192.168.187.75:2888:3888 server.2=192.168.187.77:2888:3888 server.3=192.168.187.78:2888:3888 |
Test the service:… Read more »
I found that Yakuake was re-opening with an 80% width and about 30% height but I prefer 100% wide and 80% high. So it looks like my settings were saving into the file:
|
1 |
~/.config/yakuakerc |
But this was possibly not the file that was being read when Yakuake started. I added the
|
1 2 3 |
[Window] Height=80 Width=100 |
entries to the… Read more »
So we had a CSV/TSV file with tabs separating each field but one of the fields was a description field that contained spaces. When parsing this TSV file some programs interpreted the spaces as field delimiters (TSV might be a bad idea!). Input file similar to:
|
1 |
NULL NULL 7.0 Huayang Time Warner Cable 4430 |
The ‘Time Warner Cable’ field is all one… Read more »
I installed the relevant Python packages first e.g.
|
1 |
sudo apt-get install flake8 python3-flake8 python3-pep8 python-pep8-naming python3-setuptools pylint3 |
Then on the Atom menu use: Edit > Preferences then search for atom packages such as flake8, pep8, pep257 and pylint: Then click the install button. After restarting style advice is shown in the editor:
I was reminded about how much time I had spent as a kid playing Manic Miner on an Amstrad 464 and decided to give it a try on my current desktop (Linux Mint) so for future reference… I grabbed the code created by here:
|
1 |
git clone https://github.com/lkundrak/manicminer.git |
Installed a few dependencies:
|
1 |
apt-get install libx11-dev libxext-dev |
Run the make file:
|
1 |
make |
I had inadvertently set up slave replication using the wrong channel name – which is a minor issue except that it caused some issues with an already configured Nagios check. To ‘change’ the channel name I stopped the slave process, removed all the slave definitions and used ‘CHANGE MASTER’ to re-create the slave from the… Read more »
