Introducing Apache Flume

So if you have been following my Big Data series till now, in my first article I introduced to a ready made VM image courtesy of Oracle that frees you up from the head-aches of setting things up and concentrate your time on real learning. Next article I took you on a ride with Hadoop and the primary learning point of the article HDFS (the Hadoop File system). Now we will talk about a next often used component of Big Data, Apache Flume.

Post Shell Shock - Tightening up Apache Security with mod_security and mod_evasive

Without a shadow of a doubt the Shockwell vulnerablity compromised my system. The say correctly, security should never be an after thought, although in my case, I had put it off for a bit. Maybe a correctly secured Apache configuration might have saved me, but not so sure about that anyways. Anyways the below count of strange user agents appeared in my log for the month of October. I surrounded the dots with square brackets to avoid any of you accidently clicking the below link. Out of curiosity, even I tried a wget on the url but go nothing.

Introducing Apache Hadoop

How to get started with Oracle Big Data

Big Data

Well not everyone can afford one of Oracle's Big Data Machines, but what to do if you want to get on the Big Data band-wagon. Well for educational purposes Oracle releases a Virtual Machine image called Oracle Big Data Lite.

Stress Testing Results - Round 1

So I already published a stress test plan here and how to monitor your server here. Its now time to put to put these 2 together.

My Drupal Blog Web Server Optimization - Part 2

The change that I will describe here was a direct consequence of load testing. I first stress tested the server with 5 users and than with 10 users. Till 10 users the server was just eating up the load. However with 25 users for about an hour and half it looked like a different story. You can have a look at the results yourself in this article here and the analysis. The 3rd test was done after the changes described below and it looked pretty upbeat for the 25 users for almost a couple of hours of stress testing.

Enabling Apache Status module along side Drupal CMS

So previously we talked about monitorix and how we could use it to monitor our server. The Apache graph monitor for me was completely empty. Initially it didn't bother me when I began load testing my site. But when I fine tuned my server it became a imperative to have some insight there as well. 

So its time to fix that in this article.

To monitor your apache server you need to first enable the module "mod_status". For me on my Debian system, seems this was already enabled by default. And if your also on Debian youll find the handler for it like below in the location "/etc/apache2/mods-available/status.conf". If it is also enabled for you, you'll find a symbolic link to the same under "/etc/apache2/mods-enabled/status.conf". The contents of it look like below.

My Generic Apache JMeter load testing plan

So in my last article I showed you, how you could monitor your server. Now I am going to show you, how to generate load so that the monitoring makes sense and you can fine tune your server. Quick web search showed me a number of tools, some free some otherwise. But none inspired my confidence other than the Apache JMeter tool found here.

Monitoring your server with Monitorix Securely

monitorix processor load graph

To start monitoring your server using monitorix you need to install it first.

Installing Monitorix is really simple. Just follow the steps here

Or the guide below. You can do it in 2 ways.

Manually as below :

Image optimization workflow for images on my blog

 This article is about how you can optimze the images for your website under linux and also possibly create a workflow where it is automated for you and you dont need to bother about it anymore.


Subscribe to Ahsan's Corner RSS