PDF

Analysis of Apache Logs Using Hadoop and Hive

Aleksandar Velinov, Zoran Zdravev

2018enlogshadoophiveanalysis

Abstract

Language:

In this paper we consider an analysis of Apache web logs using Cloudera Hadoop distribution and Hive for querying the data in the web logs. We used publicly available web logs from NASA Kennedy Space Center server. HDFS (Hadoop distributed file system) was used as a logs container. The apache web logs were copied to the HDFS from the local file system. We made an analysis for the total number of hits, unique IPs, the most common hosts that made requests to the NASA server in Florida, and the most common types of errors. We also examined the ratio between the number of rows in the logs and the time of execution.

Download

Cite This Work

@article{c6cc1649-9f9d-4a57-85e2-adaf4e9be498,
  title={Analysis of Apache Logs Using Hadoop and Hive},
  author={Aleksandar Velinov and Zoran Zdravev},
  year={2018},
  language={en}
}
TY  - JOUR
TI  - Analysis of Apache Logs Using Hadoop and Hive
AU  - Aleksandar Velinov
AU  - Zoran Zdravev
PY  - 2018
LA  - en
ER  -

Similar Items

Plant auditing: a powerful tool for improving metallurgical plant performance

Deepak Malhotra

This work discusses the essential components of a rigorous auditing process aimed at enhancing metallurgical plant performance. The objective is to id

2015enPDF

Unbridled coal extraction and concerns for livelihood: evidences from Odisha, India

Tattwamasi Paltasingh, Jayadev Satapathy

Coal mining and its unfavourable consequences have generated global attention. It has further stimulated the paradoxical debate of development and des

2021enPDF

Metal Casting Processes

Unknown, Unknown

This chapter discusses metal casting processes, highlighting the diversity and common characteristics among them. The objective is to elucidate the fu

2023enPDF

Artificial intelligence-aided materials design: AI-algorithms and case studies on alloys and metallurgical processes

Rajesh Jha, Bimal Kumar Jha

This book describes the application of artificial intelligence (AI) and machine learning (ML) concepts to develop predictive models that can be used t

2022enPDF

Metallurgical Plant Design and Operating Strategies

The Australasian Institute of Mining and Metallurgy

This conference, held in Perth, Western Australia, focuses on the latest advancements in metallurgical processing plant design and operational strateg

2006enPDF

Metallurgical Plant Design and Operating Strategies

David Pollard, Geoff Dunlop

The MetPlant 2008 conference focused on advancements in metallurgical processing of ores, emphasizing plant design, operation strategies, and innovati

2008enPDF