Ask SAJ

Ask SAJ: What to do with Apache logs > 50GB?

Our site at $work is generating Apache logs that, when combined sequentially into one file, are larger than 50GB in size for one day's worth of traffic. AWStats' perl script pretty much chokes when working on this much data. Last I checked, Webalizer wasn't much different, and probably wouldn't scale up to that amount of data either. Does anyone out there have any advice on a commercial solution for Apache log analysis that can scale up like that?

0
Your rating: None

Call for Comments: Help Advise an Aspiring SysAdmin

One of the things I love about blogging, and about the Internet in general, is that it makes the world much smaller. I've met so many people via my blog, it makes all the work pay off.

A good example of a blog introducing two people just happened the other day. Andrew is an aspiring sysadmin who is moving soon, and wanted to ask me some questions regarding how to "break in" to a career in systems/network administration. In my response, I asked if he would mind if I quote our conversation and post it up on my blog, so that he could ask many of us the same questions at once. He agreed emphatically. So, click through, read Andrew's questions, and comment away -- what else are you doing on a Friday???

0
Your rating: None
Syndicate content