A new Kappa Architecture for IoT Data Management in Smart Farming

[en] Agriculture 4.0 is a domain of IoT in full growth which produces large amounts of data from machines, robots and sensors networks. This data must be processed very quickly, especially for the systems that need to make real-time decisions. The Kappa architecture provides a way to process Agriculture 4.0 data at high speed in the cloud, and thus meets processing requirements. This paper presents an optimized version of the Kappa architecture allowing fast and efficient data management in Agriculture. The goal of this optimized version of the classical Kappa architecture is to improve memory management and processing speed. the Kappa architecture parameters are fine tuned in order to process data from a concrete use cases. The results of this work have shown the impact of parameters tweaking on the speed of treatment. We have also proven that the combination of Apache Samza with Apache Druid offers the better performances.

Disciplines :

Electrical & electronics engineering
Agriculture & agronomy

Author, co-author :

Nkamla Penka, Jean Bertin

Mahmoudi, Said ; Université de Mons > Faculté Polytechnique > Service Informatique, Logiciel et Intelligence artificielle

Debauche, Olivier ; Université de Mons > Faculté Polytechnique > Service Informatique, Logiciel et Intelligence artificielle

Language :

English

Title :

A new Kappa Architecture for IoT Data Management in Smart Farming

Publication date :

12 August 2021

Journal title :

Procedia Computer Science

Publisher :

Elsevier, Amsterdam, Netherlands

Issue :

191

Pages :

17-24

Peer reviewed :

Peer reviewed

Research unit :

F114 - Informatique, Logiciel et Intelligence artificielle

Research institute :

R300 - Institut de Recherche en Technologies de l'Information et Sciences de l'Informatique
R450 - Institut NUMEDIART pour les Technologies des Arts Numériques

Available on ORBi UMONS :

since 10 June 2021

Statistics

Number of views

1 (0 by UMONS)

Number of downloads

6 (0 by UMONS)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

Andriamandroso A.L.H., Lebeau R., Beckers Y., Froidmont E., Dufrasne I., Heinesch B., Dumortier P., Blanchy G., Blaise Y., and Bindelle J. Development of an open-source algorithm based on inertial measurement units (imu) of a smartphone to detect cattle grass intake and ruminating behaviors Computers and electronics in agriculture 139 2017 126 137 doi:10.1016/j.compag.2017.05.020
Bixio L., Delzanno G., Rebora S., and Rulli M. A flexible iot stream processing architecture based on microservices Information 11 2020 565 doi:10.3390/info11120565.
Debauche O., Mahmoudi S., Andriamandroso A.L.H., Manneback P., Bindelle J., and Lebeau R Web-based cattle behavior service for researchers based on the smartphone inertial central Procedia Computer Science 110 2017 110 116
Debauche O., Mahmoudi S., Andriamandroso A.L.H., Manneback P., Bindelle J., and Lebeau R Cloud services integration for farm animals' behavior studies based on smartphones as activity sensors Journal of Ambient Intelligence and Humanized Computing 10 2019 4651 4662
Debauche, O., Mahmoudi, S., Mahmoudi, S.A., Manneback, P., Bindelle, J., Lebeau, R, 2020. Edge computing for cattle behavior analysis, in: 2020 Second International Conference on Embedded & Distributed Systems (EDiS), IEEE. pp. 52-57.
Debauche, O., Mahmoudi, S., Manneback, P., Tadrist, N., Bindelle, J., Lebeau, R., 2017b. Improvement of battery life of iphones inertial measurement unit by using edge computing application to cattle behavior.
Debauche, O., Trani, J.P, Mahmoudi, S., Manneback, P., Bindelle, J., Mahmoudi, S., Lebeau, R, 2021. Data management and internet of things: A methodological review in smart farming. Internet of Things, 100378URL: https://www.sciencedirect.com/science/article/pii/S2542660521000226, doi: https://doi.org/10.1016/j.iot.2021.100378.
Feick M., Kleer N., and Kohn M. Fundamentals of real-time data processing architectures lambda and kappa Becker M. SKILL 2018-Studierendenkonferenz Informatik 2018 Gesellschaft für Informatik e.V. Bonn 55 66
Fote, F.N., Mahmoudi, S., Roukh, A., Mahmoudi, S.A., 2020. Big data storage and analysis for smart farming, in: 2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech), IEEE. pp. 1-8. doi: 10.1109/ CloudTech49835.2020.9365869.
Kreps, J., 2014. Questioning the lambda architecture. Online article, July 205.
Persico V., Pescapé A., Picariello A., and Sperlí G. Benchmarking big data architectures for social networks data processing using public cloud platforms Future Generation Computer Systems 89 2018 98 109 doi:10.1016/j.future.2018.05.068.
Persson, P., Angelsmark, O., 2017. Kappa: serverless iot deployment, in: Proceedings of the 2nd International Workshop on Serverless Computing, pp. 16-21. doi:10.1145/3154847.3154853.
Roukh, A., Fote, F.N., Mahmoudi, S.A., Mahmoudi, S., 2020. Wallesmart: Cloud platform for smart farming, in: 32nd International Conference on Scientific and Statistical Database Management, pp. 1-. doi:10.1145/3400903.3401690.
Sanla, A., Numnonda, T, 2019. A comparative performance of real-time big data analytic architectures, in: 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication (ICEIEC), IEEE. pp. 1-5. doi:10.1109/ICEIEC.2019.8784580.
Wingerath W., Gessert F., Friedrich S., and Ritter N. Real-time stream processing for big data it-Information Technology 58 2016 186 194 doi:10.1515/itit-2016-0002.
Zschörnig, T, Wehlitz, R., Franczyk, B., 2017. A personal analytics platform for the internet of things-implementing kappa architecture with microservice-based stream processing, in: International Conference on Enterprise Information Systems, SCITEPRESS. pp. 733-738. doi:10.5220/0006355407330738.