Analyzing climate change patterns with machine learning
Evaluate the potential of common machine learning models to assess climate change impact and plan for the future
Identify weather patterns outside the regional norm in Europe
Determine if unusual weather patterns are increasing
Generate possibilities for future weather conditions over the next 25 to 50 years based on current trends
Determine the safest places for people to live in Europe over the next 25 to 50 years
Data
Context
Machine learning allows organizations to analyze complex patterns such as those caused by climate change. This student project explores the machine learning models available to climate analysts and proposes three potential approaches for a fictionalized research organization, ClimateWins.
Professional Competencies
Data profiling & cleaning
Data wrangling & subsetting
Principal Component Analysis (PCA)
Supervised & unsupervised models
Deep learning models
Hyperparameter optimization
Objectives
This project uses data from the European Climate Assessment and Dataset (ECAD) project. This specific dataset includes weather observations from 18 different weather stations across Europe containing data from the late 1800s to 2022.
Phase 1: Explore Supervised Machine Learning Models
As this was my first venture into machine learning, I needed to begin by familiarizing myself with the basics. I explored the functions of fitting the model to the available data, exploring techniques such as gradient descent optimization. Taking time to understand them allowed me to better grasp the function of supervised machine learning models.
With this understanding, I ran the following supervised machine learning models on the data. I ran the ECAD data set against generated data classifying daily observations as pleasant or unpleasant weather. I ran this data using the following three models:
K-Nearest Neighbor
Decision Tree
Artificial Neural Network (ANN)
My goal was to assess the accuracy of each model and identify which had the most potential for evaluating weather data. Overall, test data accuracy ranged from 47% to 54%, though 100% unpleasant weather on one mountaintop model distorted the average.
Station-specific accuracy was higher at 85.8% to 94.4%.The confusion matrix pictured here offers more detail. As the ANN model had the highest overall accuracy, I recommended this option for further study.
Phase 2: Assess and Optimize Unsupervised Models
The next step was to evaluate unsupervised machine learning models using the same data sets. I learned and explored the following models:
Hierarchical Clustering
Random Forest
Convolution Neural Network (CNN)
General Adversarial Network (GAN)
The biggest challenge at this phase was understanding the functionality of each model. As a novice in machine learning, I relied on the explanations of more experienced users, including my CareerFoundry mentor. I learned to ask targeted questions that would help me understand the key functionalities of each model so I could optimize the hyperparameters.
Optimization was a trial-and-error process. My goal was to find the best combination of inputs to get the optimal accuracy for each model. After optimizing the model, my next step was to evaluate the feature importances of each weather stationa nd tyep of weather, to get more information about what weather data to prioriize.
Phase 3: Compare Models and Identify Next Steps
Optimization had the best results with the CNN and Random Forest models. The CNN had the most improved results, wiht accuracy incraesing from 10.4% to 61.2%. The goal was to determine strategies for enxt steps, so we evaluated the viability of GAN data to apply to the model. Optimizing the GAN model allowed me to achieve 98.1% accuracy, suggesting this approach had viability.
To learn more about how this approach works, I conducted some independent research. I found several tsudies that had applied GAN data to a CNN model to predict weather outcomes. These researchers were publishing promising results, so I suggested this as the track ClimateWins could take for promising future study.
Recommendations for Further Analysis
What additional weather data is available? ClimateWins wants to predict weather crises in order to protect human health. To answer those questions, we need data on the frequency of extreme weather events. Radar data would alos be beneficial, as the CNN model excels at processing image data.
What types of weather are associated with the greatest risk? The available data divided weather into pleasant vs. unpleasant. The analysis would benefit from information on where weather-related injuries, illnesses, and deaths ahve occurred.