Hadoop Oriented Smart Cities Architecture

In this paper, we propose a Hadoop-based architectural stack that can provide the ICT backbone for efficiently managing a smart city. On the one hand, Hadoop, together with Spark and the plethora of NoSQL databases and accompanying Apache projects, is a mature ecosystem. This is one of the reasons why it is an attractive option for a Smart City architecture.
10 months ago
Authors: Vlad Diaconita, Ana-Ramona Bologa and Razvan Bologa
 
Journal Title: Sensors
 
ISSN: 1424-8220 (Print)
 
Publisher: MDPI AG
 
Abstract
 
A smart city implies a consistent use of technology for the benefit of the community. As the city develops over time, components and subsystems such as smart grids, smart water management, smart traffic and transportation systems, smart waste management systems, smart security systems, or e-governance are added. These components ingest and generate a multitude of structured, semi-structured or unstructured data that may be processed using a variety of algorithms in batches, micro batches or in real-time. The ICT architecture must be able to handle the increased storage and processing needs. When vertical scaling is no longer a viable solution, Hadoop can offer efficient linear horizontal scaling, solving storage, processing, and data analyses problems in many ways. This enables architects and developers to choose a stack according to their needs and skill-levels.
 
In this paper, we propose a Hadoop-based architectural stack that can provide the ICT backbone for efficiently managing a smart city. On the one hand, Hadoop, together with Spark and the plethora of NoSQL databases and accompanying Apache projects, is a mature ecosystem. This is one of the reasons why it is an attractive option for a Smart City architecture. On the other hand, it is also very dynamic; things can change very quickly, and many new frameworks, products and options continue to emerge as others decline. To construct an optimized, modern architecture, we discuss and compare various products and engines based on a process that takes into consideration how the products perform and scale, as well as the reusability of the code, innovations, features, and support and interest in online communities.

 

Figure: Hadoop architecture for smart cities (credits: Vlad Diaconita, Ana-Ramona Bologa and Razvan Bologa)

 
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).
 
Read more

Comments

No comments to display.

Related posts

EU's Call for Proposals: RobotUnion acceleration program for European robotic startups and SMEs

The ideal project RobotUnion is looking for is disruptive and innovative, beyond the state of the art and with a degree of differentiation with its competitors. The ideal projects are also looking for additional investment for scaling their business globally.
Application Deadline in 2 months

Vietnamese Seafood export targets US$ 10 billion in turnover in 2019

The Vietnamese aquatic sector set a target of raising its export revenue to US$10 billion in 2019, according to the Viet Nam Association of Seafood Exporters and Producers (VASEP).

Australia Emerges as a Leading Innovator for Agriculture 4.0

Investors and researchers are looking to Australia to develop the agricultural and food technologies of the future.

Dubai’s RTA starts using robots in cleaning metro stations

Dubai’s Roads and Transport Authority (RTA) has embarked on using robots in cleaning metro stations as part of efforts to introduce new techniques driven by artificial intelligence technology.

India approves Phase-II of Grid Connected Rooftop Solar Programme for achieving cumulative capacity of 40,000 MW from Rooftop Solar Projects by the year 2022

The Cabinet Committee on Economic Affairs chaired by the Prime Minister, Shri Narendra Modi has given its approval for the Phase-II of Grid Connected Rooftop Solar Programme for achieving cumulative capacity of 40,000 MW from Rooftop Solar (RTS) Projects by the year 2022. The programme will be implemented with total central financial support of Rs.11,814 crore (1,663 million USD)

EU's Call for Proposals: eIdentification & eSignature

The Core Service Platform of eID will continue to provide support to Member States at technical and operational level. Such assistance will comprise technical support and advice, including the maintenance of the reference implementation, as well as supporting a broader uptake of eID. In addition to the support provided in previous WPs, the assistance will be extended also to the operation of the eIDAS interoperability nodes after the entry into force of the eID mutual recognition in September 2018, as well as to addressing implementation questions derived from this mutual recognition (such as identity matching issues). The support to the onboarding of new domains will be continued, with a special focus on the re-use of eID in mobile environments.
Application Deadline in 3 months

EU's Call for Proposals: Automated Translation

In 2019, the main objectives are to support the collection of language tools and resources for specific domains and for under-resourced languages as well as to stimulate the integration and take-up of CEF AT services.
Application Deadline in 3 months

Call for Proposals: Promoting leadership and economic opportunities for women across the clean energy sector in Southern and East Africa

This call is focused on promoting leadership and economic opportunities for women across the clean energy sector. We are seeking applications that propose innovative approaches to gender inclusion while also supporting core business objectives and growth. Projects will be evaluated based on concept innovation, development impact, business model and financial sustainability. Applications from women entrepreneurs and women-led organisations are strongly encouraged.
Application Deadline in a month

Call for Nominations: 2019 BBVA Foundation Frontiers of Knowledge Awards

Nominations are open for 2019 BBVA Foundation Frontiers of Knowledge Awards that recognize fundamental contributions in a broad array of areas of scientific knowledge, technology, humanities and artistic creation.
Application Deadline in 4 months