Skip to main content


Kafka MirrorMaker in Kafka

Check MirrorMaker.scala for more details.
Target cluster setupDownload and install Kafka (target cluster). Select appropriate version and download its tgz from Kafka Downloads page.tar -zxf kafka_2.11- cd kafka_2.11- Configure Target Kafka cluster's ZooKeepervim ./config/ # the directory where the snapshot is stored. dataDir=/work/kafka_2.11- # the port at which the clients will connect clientPort=2181 # disable the per-ip limit on thseparatedof connections since this is a non-production config maxClientCnxns=0 Start Target Kafka cluster's ZooKeeper./bin/ config/ Configure Target Kafka cluster's Servervim ./config/ # The id of the broker. This must be set to a unique integer for each broker. # The number of threads handling network requests # The number of threads doing disk I/O # The send buffer (SO_…

Add Environment variables and aliases to Bash on Mac OSX


Add following in ~/.profile (or ~/.bash_profile, or ~/.bashrc, or /etc/profile if you have access):
export JAVA_VERSION=1.8
export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk1.8.0_40.jdk/Contents/Home
export PATH=$PATH:$JAVA_HOME/bin

alias ll='ls -al'

# This alias recursively destroys all .DS_Store files in the folder I am currently in
alias killDS='find . -name *.DS_Store -type f -delete'

# This alias reloads this file
alias reload_profile='. ~/.profile'

# Mac get stuck very often and are extremely slow and unstable on shutdowns. This forces a shutdown.
alias poweroff='sudo /sbin/shutdown -h now'

# To ignore space changes while doing git diff
alias gitdf='git diff --ignore-space-change'

# Show Git branch in prompt
parse_git_branch() {
  git branch 2> /dev/null | sed -e '/^[^*]/d' -e 's/* \(.*\)/ (\1)/'

#Setup bash custom prompt (PS1) with autocomplete
export PS1="[\e[0;31m\u\e[m@\e[0;36m\h\e[m:\e[0;32m\$(pwd)\e[m\e[0;31m\$(parse_git_branch)\e[m]$ "

#To list files in the directory as soon you change to it
cd() {
if [ "$PS1" ]
    if [ "$1" ]
      then builtin cd "$1" && ll
      else builtin cd && ll
    if [ "$1" ]
      then builtin cd "$1"
      else builtin cd
Then load your changes without logging out:
$ source ~/.bashrc

To make autocolpete on on sigle tab (including symbolic links for directories), edit ~/.inputrc and add:
$include /etc/inputrc
set mark-symlinked-directories on
set show-all-if-ambiguous on