PROCESSING LARGE AMOUNTS OF WEATHER DATA
DOI:
https://doi.org/10.24867/26BE30RoncevicKeywords:
Big data, Data processing, CloudAbstract
In this article we present modern approach to processing large amounts of data utilizing cloud techologies. In this article the processing is done on weather data but the principles stand for various domains.
References
[1] Azure functions - https://learn.microsoft.com/en-us/azure/azure-functions/
[2] Azure data lake gen 2 - https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
[3] Azure databricks - https://learn.microsoft.com/en-us/azure/databricks/
[4] SQL Database - https://www.programiz.com/sql/database-introduction
[5] Power BI - https://learn.microsoft.com/en-us/power-bi/
[6] Apache Flink - https://nightlies.apache.org/flink/flink-docs-stable/
[7] Apache Spark ( Spark streaming ) - https://spark.apache.org/docs/latest/streaming-programming-guide.html
[8] Apache Spark - https://spark.apache.org/docs/3.4.1/
[2] Azure data lake gen 2 - https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
[3] Azure databricks - https://learn.microsoft.com/en-us/azure/databricks/
[4] SQL Database - https://www.programiz.com/sql/database-introduction
[5] Power BI - https://learn.microsoft.com/en-us/power-bi/
[6] Apache Flink - https://nightlies.apache.org/flink/flink-docs-stable/
[7] Apache Spark ( Spark streaming ) - https://spark.apache.org/docs/latest/streaming-programming-guide.html
[8] Apache Spark - https://spark.apache.org/docs/3.4.1/
Downloads
Published
2024-03-05
Issue
Section
Electrotechnical and Computer Engineering