PDF

Analysis of Apache Logs Using Hadoop and Hive

Aleksandar Velinov, Zoran Zdravev

2018enlogshadoophiveanalysis

Abstract

Language:

In this paper we consider an analysis of Apache web logs using Cloudera Hadoop distribution and Hive for querying the data in the web logs. We used publicly available web logs from NASA Kennedy Space Center server. HDFS (Hadoop distributed file system) was used as a logs container. The apache web logs were copied to the HDFS from the local file system. We made an analysis for the total number of hits, unique IPs, the most common hosts that made requests to the NASA server in Florida, and the most common types of errors. We also examined the ratio between the number of rows in the logs and the time of execution.

Download

Cite This Work

@article{c6cc1649-9f9d-4a57-85e2-adaf4e9be498,
  title={Analysis of Apache Logs Using Hadoop and Hive},
  author={Aleksandar Velinov and Zoran Zdravev},
  year={2018},
  language={en}
}
TY  - JOUR
TI  - Analysis of Apache Logs Using Hadoop and Hive
AU  - Aleksandar Velinov
AU  - Zoran Zdravev
PY  - 2018
LA  - en
ER  -

Similar Items

BLAST FURNACE IRONMAKING: Analysis, Control, and Optimization

Ian Cameron, Mitren Sukhram

This book delves into the intricate processes involved in blast furnace ironmaking, emphasizing the analysis, control, and optimization of operations.

2020enPDF

Plant auditing: a powerful tool for improving metallurgical plant performance

Deepak Malhotra

This work discusses the essential components of a rigorous auditing process aimed at enhancing metallurgical plant performance. The objective is to id

2015enPDF

AN INTRODUCTION TO THE METALLURGY OF STEEL AND ITS ALLOYS

Robert A. Francis

This document serves as a comprehensive introduction to the metallurgy of steel and its alloys, focusing on various aspects of iron and steel manufact

2017enPDF

Literature Review of Hydrometallurgical Recycling of Printed Circuit Boards (PCBs)

Hao Cui, Corby G Anderson

This study provides an up-to-date review of recycling of printed circuit boards (PCBs), specifically in hydrometallurgical treatment. Waste printed ci

2016enPDF

Current technologies for recovery of metals from industrial wastes: An overview

Santhana Krishnan, Nor Syahidah Zulkapli

Fast industrialization has increased the demand for heavy metals, while high-grade ore natural reserves are diminishing. Therefore, alternative source

2021enPDF

Direct leach approaches to Platinum Group Metal (PGM) ores and concentrates: A review

C.N. Mpinga, J.J. Eksteen

Platinum Group Metals (PGMs), often with associated gold, have very few occurrences where they are present in an ore deposit at economically extractab

2015enPDF