Electrotechnical and Computer Engineering
Vol. 39 No. 03 (2024): Proceedings of Faculty of Technical Sciences
PROCESSING LARGE AMOUNTS OF WEATHER DATA
Abstract
In this article we present modern approach to processing large amounts of data utilizing cloud techologies. In this article the processing is done on weather data but the principles stand for various domains.
References
[1] Azure functions - https://learn.microsoft.com/en-us/azure/azure-functions/
[2] Azure data lake gen 2 - https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
[3] Azure databricks - https://learn.microsoft.com/en-us/azure/databricks/
[4] SQL Database - https://www.programiz.com/sql/database-introduction
[5] Power BI - https://learn.microsoft.com/en-us/power-bi/
[6] Apache Flink - https://nightlies.apache.org/flink/flink-docs-stable/
[7] Apache Spark ( Spark streaming ) - https://spark.apache.org/docs/latest/streaming-programming-guide.html
[8] Apache Spark - https://spark.apache.org/docs/3.4.1/