Issue |
ITM Web Conf.
Volume 57, 2023
Fifth International Conference on Advances in Electrical and Computer Technologies 2023 (ICAECT 2023)
|
|
---|---|---|
Article Number | 02006 | |
Number of page(s) | 12 | |
Section | Electronics Circuits & Systems | |
DOI | https://doi.org/10.1051/itmconf/20235702006 | |
Published online | 10 November 2023 |
The Big Data for WSN Nodes: Leveraging Scalable Architecture
1 Regular Member, International Association for Engineering & Technology, Singapore.
2 Dept. of E&C Engg., Moradabad Institute of Technology, Moradabad, U.P., INDIA
3 Dept. of Electrical Engg., Moradabad Institute of Technology, Moradabad, U.P., INDIA
* Corresponding author: amitssaksena@gmail.com
Certain applications requires a scalable cost effective storage and execution system with facility to store data and have feature to analyze data to its finest granularity level in future. This increase the quality and accuracy of result analysis. Wireless sensor Network (WSN) nodes deployed for certain data intensive applications such as surveillance, war zone monitoring etc. generates a massive amount of raw data. There is an essential requirement of storing this data in its native format for analytics purpose in anticipation of future requirements. In present work, a data lake implemented on Amazon AWS is presented for storage of data in original version for future reference. Data Lake implementation service is utilized for storing the data generated in big volumes, high speed and in variety. The data in Data Lake is stored in three zones i.e. raw, reformed and curated. This paper proposes an efficient method of storing structured, unstructured and semi-structured, data in to Data Lake for future retrieval and analytics purpose. The results are comprehensively presented highlighting the advantages of using Data Lake in place of data warehouses.
Key words: Big data / Data Lake / Scalable Architecture / WSN nodes
© The Authors, published by EDP Sciences, 2023
This is an Open Access article distributed under the terms of the Creative Commons Attribution License 4.0, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.