Scalable Web Server Log Analytics with Apache Spark Assignment

Assignment Task

Using the sample HTTP sample log file available in NASA-HTTP, perform the following tasks:

1. Top 10 requested pages and the number of requests made for each

2. Percentage of successful requests (anything in the 200s and 300s range)

3. Percentage of unsuccessful requests (anything that is not in the 200s or 300s range)

4. Top 10 unsuccessful page requests

5. The top 10 hosts making the most requests, displaying the IP address and number of requests made.

6. Option parsing to produce only the report for one of the previous points (e.g. only the top 10 urls, only the percentage of successful requests and so on)

7. A README file explaining how to use the tool, what its dependencies and any assumptions you made while writing it

Levels

IC2 and IC3 candidates can use the data structures and algorithms provided by the standard library of their language of choice. IC4 and IC5 candidates need to provide their own custom implementations of storing, indexing and searching data structures and algorithms.

Git binding library

• Create a git binding library, wrapping the git cli tool, for the following actions:
• Clone repositories
• Commit changes to repositories
• Push from remote repositories
• pull to a remote repositories
• A README file explaining how to use the library, what its dependencies and any assumptions you made while writing it.

This IT and Computer Science has been solved by our PHD Experts at My Uni Paper.