Hadoop Oriented Smart Cities Architecture

In this paper, we propose a Hadoop-based architectural stack that can provide the ICT backbone for efficiently managing a smart city. On the one hand, Hadoop, together with Spark and the plethora of NoSQL databases and accompanying Apache projects, is a mature ecosystem. This is one of the reasons why it is an attractive option for a Smart City architecture.
8 months ago
Authors: Vlad Diaconita, Ana-Ramona Bologa and Razvan Bologa
 
Journal Title: Sensors
 
ISSN: 1424-8220 (Print)
 
Publisher: MDPI AG
 
Abstract
 
A smart city implies a consistent use of technology for the benefit of the community. As the city develops over time, components and subsystems such as smart grids, smart water management, smart traffic and transportation systems, smart waste management systems, smart security systems, or e-governance are added. These components ingest and generate a multitude of structured, semi-structured or unstructured data that may be processed using a variety of algorithms in batches, micro batches or in real-time. The ICT architecture must be able to handle the increased storage and processing needs. When vertical scaling is no longer a viable solution, Hadoop can offer efficient linear horizontal scaling, solving storage, processing, and data analyses problems in many ways. This enables architects and developers to choose a stack according to their needs and skill-levels.
 
In this paper, we propose a Hadoop-based architectural stack that can provide the ICT backbone for efficiently managing a smart city. On the one hand, Hadoop, together with Spark and the plethora of NoSQL databases and accompanying Apache projects, is a mature ecosystem. This is one of the reasons why it is an attractive option for a Smart City architecture. On the other hand, it is also very dynamic; things can change very quickly, and many new frameworks, products and options continue to emerge as others decline. To construct an optimized, modern architecture, we discuss and compare various products and engines based on a process that takes into consideration how the products perform and scale, as well as the reusability of the code, innovations, features, and support and interest in online communities.

 

Figure: Hadoop architecture for smart cities (credits: Vlad Diaconita, Ana-Ramona Bologa and Razvan Bologa)

 
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).
 
Read more

Comments

No comments to display.

Related posts

Continental free trade area to boost e-commerce in Africa

High-level session at UNCTAD's Africa eCommerce Week shows that the continent has the potential to scale e-commerce enterprises - but its new free trade area will be key.

Bayer helps farmers keep sows healthy with new BCS SowDition smartphone application

BCS SowDition enables accurate and standardized body condition scoring of sows in four simple steps, contributing to better health and management.

Call for applications: 2019 Syngenta Crop Challenge in Analytics prize

Corn is one of the world’s most important crops. Each year, breeders create several new corn products, known as experimental hybrids. Corn breeders work to create corn hybrids that can maintain high yield across a wide range of environments.
Application Deadline in a month

Application of the IoT technologies in the poultry chain

The growth of poultry relies on the environment in which the bird feels comfortable, as well as on good-quality feed and water. In this use case, the performance of the poultry production chain is optimised through IoT driven technologies.

New Initiative to Mitigate Risk for Global Solar Scale-up

The World Bank and Agence Française de Développement (AFD) are developing a joint Global Solar Risk Mitigation Initiative (SRMI), an integrated approach to tackle policy, technical and financial issues associated with scaling up solar energy deployment, especially in some of the world’s poorest countries.

Challenges and opportunities of introducing Internet of Things and Artificial Intelligence applications into Supply Chain Management

The study examines the challenges and opportunities of introducing Artificial Intelligence (AI) and the Internet of Things (IoT) into the Supply Chain Management (SCM). This research focuses on the Logistic Management. The central research question is “What are the key challenges and opportunities of introducing AI and IoT applications into the Supply Chain Management?”

Internet of Robotic Things – Converging Sensing/Actuating, Hyperconnectivity, Artificial Intelligence and IoT Platforms

The Internet of Things (IoT) concept is evolving rapidly and influencing new developments in various application domains, such as the Internet of Mobile Things (IoMT), Autonomous Internet of Things (A-IoT), Autonomous System of Things (ASoT), Internet of Autonomous Things (IoAT), Internet of Things Clouds (IoT-C) and the Internet of Robotic Things (IoRT) etc. that are progressing/advancing by using IoT technology.

3D Food Printers Market Driven by Growing Demand for Customized Food

The 3D food printers market is expected to grow at a robust CAGR from 2017 to 2028. This market growth is expected to be driven by factors such as the growing demand for customised food and the development of the industrial sector in this region.

Vision-Based Apple Classification for Smart Manufacturing

In this paper, an accurate data capture approach based on a vision sensor is proposed. Three image recognition methods are studied to determine the best vision-based classification technique, namely Bag of Words (BOW), Spatial Pyramid Matching (SPM) and Convolutional Neural Network (CNN).

Intel Drone Solutions Modernize and Increase Efficiency for US Bridge Inspections

Intel collaborated with two departments of transportation to improve bridge inspections, supplementing manual inspections of the Daniel Carter Beard Bridge connecting Ohio and Kentucky and the Stone Arch Bridge in Minnesota. Throughout the inspections, Intel’s advanced automated commercial drone hardware and software solutions increased efficiency and produced more reliable data in a fraction of the time and cost of traditional methods.