PROCESSING LARGE AMOUNTS OF WEATHER DATA

Authors

  • Nikola Rončević Autor

DOI:

https://doi.org/10.24867/26BE30Roncevic

Keywords:

Big data, Data processing, Cloud

Abstract

In this article we present modern approach to processing large amounts of data utilizing cloud techologies. In this article the processing is done on weather data but the principles stand for various domains.

References

[1] Azure functions - https://learn.microsoft.com/en-us/azure/azure-functions/
[2] Azure data lake gen 2 - https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
[3] Azure databricks - https://learn.microsoft.com/en-us/azure/databricks/
[4] SQL Database - https://www.programiz.com/sql/database-introduction
[5] Power BI - https://learn.microsoft.com/en-us/power-bi/
[6] Apache Flink - https://nightlies.apache.org/flink/flink-docs-stable/
[7] Apache Spark ( Spark streaming ) - https://spark.apache.org/docs/latest/streaming-programming-guide.html
[8] Apache Spark - https://spark.apache.org/docs/3.4.1/

Published

2024-03-05

Issue

Section

Electrotechnical and Computer Engineering