Newsletter, November 20221. To our dear readers
It is more than two years since our first monthly newsletter. Thank you for showing interest in our work. This means a lot to us. In order to serve our readers more efficiently we have a request for you. Please write to firstname.lastname@example.org and let us know what would make our newsletter more useful and interesting for you. Your feedback is very much appreciated.
Jürgen Lina, business development manager
A year later, we are happy to announce that KappaMask v2 is finally out! Now, KappaMask v2 can detect clouds all over the globe in any season. It was trained on KappaSet, a large and diverse cloud and cloud shadow dataset developed with the help of active learning. We believe KappaSet will benefit the research community and boost cloud masking development. KappaSet is available here: https://zenodo.org/record/7100327
KappaMask v2 is free and can be found here: https://github.com/kappazeta/km_predict
Feel free to try it yourself and let us know about your experience!
Tetiana Shtym, machine learning engineer
Newsletter, October 20221. KappaZeta at the Agroinsurance International Conference 2022
KappaZeta had a great opportunity to visit the AgroInsConf 2022 in beautiful Tbilisi in Georgia, which was designed to bring together agricultural insurance companies, reinsurance companies, brokers and insurtech companies. A lot of topics were covered during the conference from the overview of agricultural insurance markets to problems that insurance and reinsurance companies are facing and how technological applications of satellite imagery can help in solving them. The conference ended with a field day, where we had a chance to test out existing technological solutions for loss adjustment.
It was a pleasure to see that insurance companies understand the value that EO solutions can provide them and it’s a matter of time when satellite data will be used by most of the insurance companies in the world. KappaZeta’s expertise is in using SAR (radar) satellite data, incorporating it with optical satellite data and providing some of the most accurate AI models on the market. Radar data is different than most other satellite data because it is not dependent on weather or daylight, and thus is able to provide data on days where other satellites cannot because of clouds. Having data is extremely important for insurance companies no matter what the weather is like. That is the main reason why a lot of the insurance companies are looking forward to cooperating with us and vice versa.
Figure 1. The participants of the Agroinsurance International Conference 2022, image by www.agroinsurance.com.
Tanel Kobrusepp, product manager of crop insurance oriented services
In the past we have modeled and reported SNDVI on the level of image sub-tiles (512 x 512 px.). However, NDVI values are as important as the parcels they’re measured on hence recent evaluations have focused on in-field changes. This newsletter article discusses one such, exploring spring barley growth with SNDVI images.
NDVI increases with crop growth for spring barley till after the flowering stage (where it peaks) and decreases as plant dries up in preparation for harvest. By categorizing some of these growth stages, we have discovered the model accuracies for monitoring early growth, especially between sowing, seed emergence and early tillering could be significant, if not practical for monitoring fields in the absence of cloud-free images.
The parcels in Figure 2 & Figure 3 compare historical NDVI (HNDVI) inputs, predicted SNDVI and target NDVI images as the fields move from bare soil to what could be an early tillering stage in spring barley. The synthesized images can identify zones or direction of growth (as growth is not even across the field).
Newsletter, September 2022Please take 5 minutes and see what has kept us busy. In point three we invite you to vote.
1. KappaZeta at the International Astronautical Congress
KappaZeta was present in the IAC expo area in Estonia’s Software Defined Space booth from September 18-22. Over the five days in Paris, our COO Karoli Kahn had the pleasure of introducing KappaZeta to entrepreneurs, public sector representatives and students from all over the world. We had the opportunity to finally meet face to face with good partners and plant the seeds for new initiatives. Meeting professionals from all over the world provided good insight into new trends of agricultural services.
The expo with around 250 exhibitors also made it easy and interesting to gain a better perspective of the many public actors and companies all over the world that are operating Earth Observation satellites and providing the data for free or at a competitive price point. It was clear that EO activities are booming both upstream and downstream. However, very good SAR expertise is still rare – a problem KappaZeta can help with. It will be exciting to share all the new inspiring ideas with the KappaZeta team and set up follow-up meetings to discuss cooperation opportunities with the newly made contacts. Thank you to everyone who was interested to hear about KappaZeta and to Enterprise Estonia for organizing participation at the IAC with a joint Estonian booth.
The next big conference where you can meet KappaZeta is Agroinsurance International Conference on 26-28 September in Tbilisi, Georgia, where product manager Tanel Kobrusepp will be exploring in-depth the ecosystem and opportunities of agricultural insurance.
KappaMask v2 was trained on KappaSet and hence naturally adapted for different geographical locations and seasons. Another improvement over the previous version is the faster processing time. It takes only around 3 minutes to get a classification mask. We compared KappaMask v2 with other cloud masking processors including Sen2Cor, Fmask, MAJA, IdePix and S2Cloudless on the challenging and diverse test set. KappaMask v2 demonstrated exceptional performance reaching the highest accuracy and outperforming all the above-mentioned methods.
KappaMask v2 is available to everyone here: https://github.com/kappazeta/km_predict
Feel free to check it out and share your experience with us!
3. KappaZeta is in the finals
Tartu Postimees is organizing a nice contest to find out the product of the 2022 of the City of Tartu and Tartu county. If you agree that KappaZeta deserves the award please give us your vote at https://tartu.postimees.ee/7610731/haaletus-aita-valida-tartu-ja-tartumaa-aasta-toodet
Newsletter, August 2022Summer in Estonia is about to end and our team is getting more and more busy. These are the latest news from our team.
1. Important in August
Vacations are mainly over, and August has been a busy month in and around KappaZeta.
Firstly, I’m glad to welcome Tanel Kobrusepp to our team as the product manager of crop insurance oriented services from 1st
of August. Tanel has important mission to lead our business and product
development in the growing agri-insurance services market. KappaZeta
has been traditionally strong in science and engineering and not so on
the business side. With Tanel Kobrusepp joining this is about to
improve. Coming months will tell. I wish Tanel a lot of courage to take
the leadership, make clients happy and things happen.
While making deals and developing the business, it is equally important to be deep and have content. In August two important PhD thesis were defended in the University of Tartu. On 23rd of August KappaZeta’s friend and an unofficial team member Tauri Tampuu defended his PhD thesis “Synthetic Aperture Radar Interferometry as a tool for monitoring the dynamics of peatland”. After mine, Karlis Zalite’s, Aire Olesk’s and Tanel Tamm’s doctoral thesis this was the 5th doctoral thesis in the University of Tartu on synthetic aperture radar data. Welcome to the club, Tauri!
On 25th of August KappaZeta’s software developer Heido Trofimov defended his PhD thesis “Polluted clouds at air pollution hot spots help to better understand anthropogenic impacts on Earth’s climate”. An important piece from the critical puzzle to understand how we humans alter the climate on Earth. Heido is now the 5th member in KappaZeta team with doctor’s degree. Congratulations!
It has also been busy days with improving KappaMask, our free and open cloud mask for Sentinel-2, even if the results are not yet so visible. By August more than 5000 Sentinel-2 sub-tiles have been carefully manually labelled to give our AI model a high-quality global reference set, which is a pre-requisite for a globally accurate cloud mask – your AI model is just as good as your reference data. Great job, our interns Abdullah, Catherine, Joosep, Mariana and Nikita for doing the hard work and Olga & Tanya for managing the development and improving the model. I’m sure the results will be satisfying once we measure the accuracy and KappaMask will be an important tool for the world in taking full advantage of Sentinel-2 data.
Figure 1. Kaupo and Karoli in sTARTUp day 2022 business festival. A very useful networking event to establish new contacts and refresh the old ones.
On the other hand, ~87% of crop fields in the U.S. are insured, with more than 1.1 million policies issued in 2021.
There are a lot of blockers on both, the producers and insurance side, that are causing the underuse of crop insurance. The main blockers for producers to insure their fields are price, lack of flexibility for custom terms from the insurance companies and lack of insurance products to choose from.
New technologies and data need to be incorporated into insurance companies’ work to increase the amount of tailor-made insurance policies in a cost-effective manner, thus increasing the interest in crop insurance products.
One option is to use Earth Observation (EO) data, which has endless opportunities from faster underwriting and better risk assessment to reducing costs on time-consuming and expensive claims handling. Imagine a loss adjuster going to a 3m high maize field, where a loss has occurred. Using satellite data, the loss adjuster can automatically see on a portable device, where exactly the damages happened, so he/she does not have to spend hours looking for the damaged areas. It is also very difficult to assess the extent of the damage with bare eyes, but it can definitely be done by AI, which could automatically determine how many acres were damaged, using satellite imagery.
Our main goal right now is to determine the biggest problems that the agricultural insurance providers face and prioritize our development of solutions according to their needs.
I am very excited to be working on these solutions with my amazing team of AI, Machine Learning and Earth Observation specialists. If this is a topic that you feel related to, don’t hesitate to get in touch with me at email@example.com.
Tanel Kobrusepp, product manager of crop insurance oriented services
Newsletter, July 20221. ESA Latvia Workshop 2022
12th ESA Training Course on Earth Observation (EO) took place in Riga
Technical University from June 27 to July 1. Targeting researchers and
young professionals from in and around the Baltic area in EO, we
participated (remotely and in-person) in theory and practical sessions
covering (Interferometric) SAR, and applications of satellite data in
Forestry, Agriculture and Marine observations.
Figure 1. ESA Workshop in Latvia.
It was heart-warming to see our Mowing and Grazing projects featured in different presentations, and exciting to learn more about the implementation (and challenges) of agricultural projects similar to our current portfolio, directly from ESA experts. The sessions were a blend of interactive theory discussions and hands-on data processing or analyses of radar and optical satellite data with old and new GIS tools. These new tools (including ForestryTEP, OpenEO Cloud) are mostly focused on aggregating satellite data sources and easing access to, and processing on this data.
Many great meetings with young bright space enthusiasts, who learned a lot about the space sector in Estonia and how could the open-source satellite data be used. Many Estonian companies working in the field of space presented their challenging work and impressive research.
Olga Wold, geospatial data quality specialist
Newsletter, June 20221. Webinar: “KappaOne – Sentinel-1 data layers for the subsidy checks under CAP”
Sentinel-1 is a radar satellite that works both day and night and can see through the clouds and is, therefore, an excellent source of data for monitoring changes in agricultural land. The KappaOne service is designed to make Sentinel-1 SAR data easily accessible and ready to be used and analysed. It is extremely helpful for the subsidy checks under the Common Agricultural Policy (CAP). For example, it is valuable for planning field visits to the most problematic areas and getting an initial overview of the field before leaving the office. Moreover, it is applicable for checking the parcels manually, where the machine learning model gives an uncertain or borderline result. Sentinel-1 images are also well suited for assessment of mowing, harvesting, ploughing and other markers.
Join the KappaOne webinar to learn more about the service and its use cases for the subsidy check under CAP. The webinar will be held on the 30th of June from 15:00 until 16:00 EEST. You can register here: https://forms.gle/dzYjorhjrPNxRYym7
Kaupo Voormansik, CEO, SAR expert
3. NISAR is coming
There are several new and interesting upcoming SAR missions including Copernicus ROSE-L, Sentinel-1 NG, ALOS-4 and NISAR. Perhaps the most interesting in the near future is NISAR jointly developed by NASA and ISRO (Indian Space Research Organisation). The satellite is almost ready with the testing and qualification procedure yet to be concluded before the launch, which is expected to early 2024. NISAR is very interesting mission because of three reasons, firstly it is a dual-band mission acquiring SAR data simultaneously in S- and L-band. It will be a Sentinel-1 like data factory imaging the whole planet several times per week and its data policy is planned to be free and open.
The last two points are very important for an operational service development point of view. KappaZeta will keep an eye on NISAR developments and help the world to make the most of this beautiful up-and-coming SAR data factory. If everything goes well people can access and use NISAR data in a simple way via our KappaOne service starting from 2024.
Newsletter, May 2022
1. KappaZeta in the Living Planet Symposium
It is 23rd of May 2022 and we are glad to share that we are present at European Space Agency Living Planet Symposium in Bonn!
On Friday 27th of May, our CEO Kaupo Voormansik will give an oral presentation on “High quality food for AI - Sentinel-1 analysis-ready data (ARD) with interferometric coherence”. The presentation will focus on freshly launched KappaOne service. The SAR expertise of KZ helps to take full advantage of the interferometric and polarimetric data content of Sentinel-1. And for the end-user, it means calibrated and noise corrected imagery products with the highest possible spatial resolution using advanced speckle suppression methods.
On Tuesday our EO analyst Jelizaveta Vabistsevits will give a session on “KappaOne fresh Sentinel-1 data layers’ use case examples for the subsidy checks in Common Agricultural Policy”. She will tell you about KappaOne and its use case for the CAP subsidy checks through a hands-on experience!
On Friday there will also be a poster presentation on “AI-based Cloud Mask Processor for Sentinel-2” by Olga Wold, our Geospatial Data Quality Specialist. This presentation will describe the KappaMask model details and its progress on going global!
See you at the Living Planet Symposium 2022!
The initial stage of the research was carried out with the cooperation of local farmers, who provided information about the general condition of agricultural parcels and granted access to the croplands for field surveying. During the in-person visits that took place early in July 2021, a visual assessment of various winter and spring vegetation types was performed and georeferenced images from across the fields were taken. Extra attention was paid to the difference between crop condition within damaged and healthy areas.
The results of the preliminary analysis on a test subset of agricultural parcels vary. The number of parcels in the current stage of analysis was quite limited and it caused several issues. Nevertheless, using simple unsupervised classification techniques it is possible to obtain a spatial representation of the damaged areas through the analysis of specific features of winter rapeseed at particular stages of its development.
At the next stage of the analysis, the work will be continued in the scope of supervised classification techniques combined with individual approaches to various agricultural crop types.
Anton Kostiukhin, software developer
Newsletter, April 20221. Advanced speckle filtering
Our raster processing got a major upgrade that significantly improves the quality of our backscatter and coherence rasters. We analyzed, modified and combined multiple published methods when designing a new filter for KappaOne. Although the filter adds significant load to the computations, the output raster will become much sharper with it as the edge structures are preserved much better.
To demonstrate the impact of a new filter to the backscatter images, we chose an area that has comb-shaped parcel on it (see the bottom right corner of figure 1). The narrow “teeth” of the comb are about 20 meters in width. Although “teeth” were also visible previously, their sharpness on KappaOne output is drastically higher.
The newly created KappaOne filter allows improving the quality of coherence images as well. On figure 2 the same area is used for demonstration as previously. Now the comb-like structure is gone, as for coherence more averaging is needed to produce meaningful output. There are large high coherence areas on the previous coherence image, which are created by objects that create extremely high coherence. One of those areas is marked by an ellipse on figure 2. Our novel filter helps to significantly shrink the area where those coherence values dominate. As a result, we can produce an image with much finer details on it.
However, we are tackling new challenges at this stage, foremost of which is validating the SNDVI rasters. Validation involves evaluating the quality of images generated by our model, and the accuracy of parcel-level SNDVI compared with available NDVI. We have made significant progress in the former as reported in previous issues, however by the next issue on SNDVI we plan to have a comparable SNDVI timeseries (in addition to partial NDVI timeseries) in the demo map to validate newly created rasters. Most importantly, we want to learn more about the model as we scale and validate on new data and unseen areas, to improve the accuracy and reliability of predictions.
Newsletter, March 20221. KappaMask for Sentinel-2
Previously, KappaMask misclassified water as cloud shadows or semi-transparent clouds, or even as invalid pixels. Now, the model predictions look reasonable, however errors still occur.
On Figure 2, KappaMask predictions are presented in desert areas. You can see that most of the clouds and shadows are predicted correctly. Although, some of the terrain conditions are misclassified as cloud shadows and missed semi-transparent clouds are presented. Therefore, there is a lot of work still to be done!
Few weeks later the same team got an honorable mention in Valtra Hackathon with a concept of automatic log generation of farming events (ploughing, sowing, mowing, harvesting etc.) for non-smart tractors.
More info at:
Kaupo Voormansik, CEO, SAR expert
Newsletter, February 20221. Grazing detection based on Copernicus data
Fieldwork was a significant part of ground reference data collection required for the development of grazing detection methodology. We have collected the data about grazing and mowing events and grass height weekly during summer 2021 from several grasslands in central Estonia. Summary of the data together with S2 NDVI, NDWI, and PSRI indices and calculated grazing intensity for two grasslands is visualized in the figure below.
On these grasslands, cows moved from one field to another throughout the summer, staying on each grassland for up to 5 weeks. In Figure 2 it is visible that grassland V2 was separated by the farmer into two parts. The larger part was mowed on the 30th of June for silage, which is visible from the NDVI, NDWI, and grass height drop on the time series. Animals were located on the smaller part of the V2 before and after the mowing event. Due to the mowing event in between, it is quite hard to distinguish changes caused by grazing activity, even though the grazing intensity is high (4.2 LU/ha).
Changes in biomass on the grasslands are mostly visible on Sentinel-2 NDVI rasters, as the increase or decrease of NDVI values are more distinguishable by the human eye (Figure 2). In comparison, the visual analysis of Sentinel-1 raster parameters is more complex. The changes in VV or VH coherence values are difficult to detect if the exact location of animals is missing (Figure 3). However, the machine learning approach can be implemented in future works. As grazing is not distinguishable for the human eye on Sentinel-1 images, some of the signatures can be detected by the AI model.
KappaZeta and CarbonEye Global are to deliver new breed innovative solutions that fuse Carbon, Space and Agricultural markets to Kemira and Valtra hackathons in Finland in March 2022. Hackathons are organized by Jyväskylä University (JAMK) in cooperation with global segment leader Kemira Oyj (Chemicals company) and Valtra Inc. (Smart Tractors company). More here. For further enquiries please contact firstname.lastname@example.org and email@example.com.
Read more about the hackathons:
Kaupo Voormansik, CEO, SAR expert
Newsletter, January 2022
Currently, one can see backscattering in VH, a coherence image of VV in 6/12 interval, and RGB composite of previous two plus backscatter in VV. In addition, we provide a custom product – synthetic NDVI, a product where an AI algorithm derives current NDVI from Sentinel 1 image, using history of Sentinel 1 and Sentinel 2 data. This way, an NDVI can be given for dates when clouds do not permit optical satellites to get useful data.
For parcels, by which we mean a continuous agricultural area with size larger than 0.5 hectares, we provide statistical information, which can be viewed either in the web map or accessed directly via an API. The statistics uses the same information that is available in raster but aggregated over the parcel area. This data, represented as time series, allows detection of biomass changes and farming events like haying, harvesting and ploughing, but also natural events of significant influence, like flooding or hail damage.
We provide two examples for the service in our initial demo, one for Germany https://demodev2.kappazeta.ee/ard_demo/ and one for Estonia https://demodev2.kappazeta.ee/ard_ee/. We encourage you to test the services and let us know what you think.
The KappaOne service development is funded by the InCubed program of ESA ɸ-lab.
Since the last issue, we have prepared NDVI images for a 50×50km demo area in Northern Germany spanning 5 months (May to September). We replace cloudy image tiles with inferred synthetic NDVI (sNDVI) images, using historical NDVI and Synthetic Aperture Radar (SAR) data from the same area as inputs for the model. A sub-section of this demo area is pictured below (Figure 4), with the color scheme (ranging from brown through yellow to green) showing increasing areas of healthy vegetation, estimated by NDVI.
This demo is available in KappaZeta web map environment and includes other SAR data - backscatter and coherence - over the same area.
Interaction with red-outlined parcels, reveals rich temporal information of selected fields, as averaged parcel statistics over the entire demo period (April – December 2021) and can be used to compare accuracy of synthetic NDVI images. For now, not all areas have NDVI images for the entire period since historical inputs are required for image synthesis and some areas did not have sufficient cloud-free historical images for prediction. Months with dense NDVI coverage are May, June, and September.
An evaluation of model accuracy over some test images (212 images sized at 512px) from this period, shows synthetic images have a mean structural similarity (or reconstruction accuracy) of 82% and absolute pixel error of 6.86%. The next challenge is making all synthetic images available, even for areas with insufficient historical data.