Agile has been followed in some form or the other all the software development teams that I have worked for. Most teams used sprints and daily scrum meeting only. Some teams used sprint planning meetings where you decided the ticket that you would work on during the sprint. I have often seen that the Product…
I work in a very small team of three engineers which does not leave much room for dedicating resources for managing infrastructure. We wanted explore managed AWS solutions so that we can focus on delivering features without worry about scaling the infrastructure or dealing with maintaining servers. This post briefly describes the new technologies that…
Screen is a program that runs in terminal and allows you to create multiple terminals with one ssh login. It runs in background so that you can attach to the same session if ssh disconnects. Its particularly useful when you are using mobile data or have to leave some process running in foreground. You can…
During migration of a website which has not been updated in a while, it occured to me that docker will be ideal for this website. It did not have a lot of traffic and business impact was also less. So I gave myself a few days to deep dive and learn it. The documentation and…
I wanted to run a job which runs 24×7 and which reports if certain keywords occur more than a N times in the stream. Spark streaming looked a ideal candidate for this task. Spark has a reduceByKeyAndWindow function which was exactly what I was looking for. I decided to use a window length of 1 minute and…