Deutsch Intern
Professorship for Space Technology

SONATE-2

Project Overview

The SONATE-2 mission will verify novel artificial intelligence (AI) hardware and software technologies in miniaturized format in a low Earth orbit. By using such AI technologies, the satellite will be able to analyze the environment autonomously with its multiple sensors in visible and near infrared spectrum. Deep learning plays a central role as a versatile image processing tool. Thus, in addition to the classification of targets already known at the start of the mission, the payload will also have the capability of anomaly detection by on-board training for the detection of previously unknown objects or phenomena. As one of the secondary objectives, SONATE-2 will also be able to detect transient light phenomena such as lightnings by using image processing algorithms. In the future, these technologies could be used, for example, in small satellite missions to explore the solar system.

Mission Statement:

Development and operation of a technology testing satellite for highly autonomous payloads and artificial intelligence.

Start of the project: 01.03.2021
Duration: 4 years
Funding Code: 50RU2100

Contact:

The SONATE-2 mission will verify novel artificial intelligence (AI) hardware and software technologies in miniaturized format in a low Earth orbit. By using such AI technologies, the satellite will be able to analyze the environment autonomously with its multiple sensors in visible and near infrared spectrum. Deep learning plays a central role as a versatile image processing tool. Thus, in addition to the classification of targets already known at the start of the mission, the payload will also have the capability of anomaly detection by on-board training for the detection of previously unknown objects or phenomena. As one of the secondary objectives, SONATE-2 will also be able to detect transient light phenomena such as lightnings by using image processing algorithms. In the future, these technologies could be used, for example, in small satellite missions to explore the solar system.

The successful launch of SONATE-2 took place on March 4, 2024 from California on board a Falcon 9 launcher as part of the Transporter 10 mission.

2024[ to top ]
  • In-Orbit Validierung des MultiView-Sternsensors auf dem SONATE-2 CubeSat. Neumann, Tobias; Balagurin, Oleksii; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Riegler, Clemens; Schwarz, Tobias. In Deutscher Luft- und Raumfahrtkongress. Deutsche Gesellschaft für Luft- und Raumfahrt - Lilienthal-Oberth e.V., 2024.
  • 6U+ CubeSat SONATE2: Operation of an Optical AI Payload in Low Earth Orbit. Herbst, Tobias; Balagurin, Oleksii; Greiner, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Schwarz, Tobias. In 75th International Astronautical Congress (IAC). 2024.
  • Novel On-Board Data Processing Strategies on Nanosatellite SONATE-2. Maurer, Andreas; Balagurin, Oleksii; Greiner, Tobias; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Schwarz, Tobias. In Small Satellites, System & Services Symposium (4S). Palma de Mallorca, Spain, 2024.
  • Early Results and In-Flight Experience of the 6U-Mission SONATE-2. Schwarz, Tobias; Balagurin, Oleksii; Greiner, Tobias; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas. In Small Satellites, System & Services Symposium (4S). Palma de Mallorca, Spain, 2024.
  • Erste Flugergebnisse der Satellitenmission SONATE-2. Balagurin, Oleksii; Greiner, Tobias; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Männel, Jonathan; Maurer, Andreas; Neumann, Tobias; Riegler, Clemens; Schwarz, Tobias. In Deutscher Luft- und Raumfahrtkongress. Deutsche Gesellschaft für Luft- und Raumfahrt - Lilienthal-Oberth e.V., 2024.
2023[ to top ]
  • SONATE-2 – Using Artificial Intelligence for In-Orbit Image Processing and Anomaly Detection. Greiner, Tobias; Balagurin, Oleksii; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Schwarz, Tobias. In 14th IAA Symposium on Small Satellites for Earth Observation. Berlin, 2023.
  • SONATE-2 – A Technology Demonstration Mission of Artificial Intelligence for Image Processing and Anomaly Detection. Greiner, Tobias; Balagurin, Oleksii; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Schwarz, Tobias. In 16th Pico- and Nano-Satellite Workshop. Würzburg, Germany, 2023.
  • Attitude-independent calibration of magnetometers in orbit using Particle Swarm Optimization. Kaiser, Tobias; Thois, Dominik; Balagurin, Oleksii; Greiner, Tobias; Kayal, Hakan; Schwarz, Tobias; Maurer, Andreas; Herbst, Tobias; Riegler, Clemens. In 14th IAA Symposium on Small Satellites for Earth Observation. 2023.
2022[ to top ]
  • Hardware and Software Redundancy Concepts on-board of SONATE-2. Maurer, Andreas; Balagurin, Oleksii; Greiner, Tobias; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Riegler, Clemens; Schwarz, Tobias. Vol. IAC 2022 congress proceedings, p. 11. International Astronautical Federation (IAF), 100 Avenue de Suffren 75015 Paris, France, 2022.
  • Testing the NVIDIA Jetson Xavier NX Module for the SONATE-2 Nano Satellite Mission. Herbst, Tobias; Balagurin, Oleksii; Greiner, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Riegler, Clemens; Schwarz, Tobias. Vol. IAC 2022 congress proceedings, p. 7. International Astronautical Federation (IAF), 100 Avenue de Suffren 75015 Paris, France, 2022.
  • SONATE-2 - A Technology Demonstration Mission for Artificial Intelligence. Greiner, Tobias; Balagurin, Oleksii; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Neumann, Tobias; Riegler, Clemens; Schwarz, Tobias. In Small Satellites, System & Services Symposium (4S), G. Tobias, B. Oleksii, H. Tobias, K. Tobias, K. Hakan, M. Andreas, N. Tobias, R. Clemens, S. Tobias (eds.). Vilamoura, Portugal, 2022.
2021[ to top ]
  • Development and operation of a technology testing satellite for highly autonomous payloads and artificial intelligence. Balagurin, Oleksii; Greiner, Tobias; Herbst, Tobias; Kaiser, Tobias; Kayal, Hakan; Maurer, Andreas; Neumann, Tobias; Riegler, Clemens; Schwarz, Tobias. In 14th Pico- and Nano-Satellite Workshop. Würzburg, Germany, 2021.

During the first activation of the APRS digipeater, 421 messages were forwarded. A complete success and another opportunity to support the worldwide amateur radio service through the SONATE-2 mission!

more

SONATE-2 has successfully observed Hurricane Beryl from orbit. The 6U+ satellite was able to record a sequence of high-resolution images in the NIR range (763-801nm) during a pass over the hazardous hurricane.

more

BR  Video Report on SONATE-2 (DE)
 

A video report (DE) with an interview with Prof. Kayal was published for the BR Frankenschau. In it, he explains the background to the satellite launch and gives an insight into the profressorship's mission control center, which was described by the Bavarian Minister of Science, M. Blume as 'Houston am Main'.

(Bild: R.Emmerich)

Tagesschau Artikel zu SONATE-2 Start

The SONATE-2 launch to test AI technologies in space attracted a great deal of media attention, including an article in the Tagesschau (DE), which shed light on the background ot the mission and the work at the professorship.

 

Additional press releases on the project:

06.03.2024 - BR (Videobeitrag) Nanosatellit erfolgreich ins All gestartet

06.03.2024 - BR - Meilenstein in Würzburg: Unisatellit in den Weltraum gestartet

05.03.2024 - MainPost - Erfolgreicher Start in den Weltraum

05.03.2024 - Tagesschau - Deutsche KI im All

05.03.2024 - JMU press article on the successful launch of SONATE-2

06.11.2023 - JMU press article on the development and objectives of SONATE-2

02.07.2021 - Vorbereitet auf die Zukunft, Presseartikel Süddeutsche Zeitung

14.04.2021 - JMU press article on SONATE-2

+++ Liveticker +++

Link to livestream (finished): https://www.youtube.com/watch?v=4qOBXHmDCUU

13.05.2024 First high-resolution image of SONATE-2

We have taken and downloaded the first high-resolution images of the SONATE-2 nano-satellite. Here you can see an image from our wide-angle colour camera. It shows a part of North Africa and the Strait of Gibraltar.

16.04.2024 We are celebrating 42 days of uninterrupted operation of the SONATE-2 on-board computer.

02.04.2024 First time training of the anomaly detection networks in orbit completed!

20.03.2024 Official NORAD ID assigned

In the past few days SONATE-2 has been added to the official NORAD catalog aufgenommen.

  • International Designator: 2024-043Q
  • NORAD-ID: 59112

 

12.03.2024 First image of SONATE-2 downloaded successfully!

First wide field of view image from SONATE-2 downloaded successfully!
This is a reduced and compressed version of the raw image.

Can you guess which coastline you can see here?

08.03.2024 First SSTV message received from SONATE-2

Today, for the first time, an image previously stored on board was successfully transmitted via SSTV (Slow Scan TV).
This is a low-resolution image transmitted via an analogue transmission method in an amateur radio band.



Dates for further transmissions can be found here.

06.03.2024 Press conference

Together with the President of the University, we celebrated the successful launch of SONATE-2 at a press conference. (Image: R.Emmerich)

 

06.03.2024 First ADCS data downloaded

As part of the LEOP operations, the redundant ADCS system was operated for the first time today and various status data was collected. All downloaded data of the satellite are within the expected range. The plot shows the rotation rates of SONATE-2 over time. (Figure T.Kaiser).

06.03.2024 Onboard computer is running very reliably

The SONATE onboard computer, which forms the "brain" of the satellite and an in-house development of the Professorship of Space Technology, is proving to be very reliable and has so far run without rebooting. An up-time of > 1 day was already achieved yesterday, as the housekeeping data shows (parameters OBDH1 UPTIME, OBDH3 UPTIME; image: H.Kayal).

06.03.2024 Picture of the SONATE-2 deployment

Image of SONATE-2 during the deployment as one of SpaceX's Transporter-10 missions payloads on March 4, 2024 (Image source: SpaceX, edited by J. Männel)

 

05.03.2024 - 15.30 New TLE data published

Updated TLE data has been published:

SONATE-2               
1 70309C 24043J   24064.95799882  .00043189  00000+0  22599-2 0    01
2 70309  97.4633 190.2549 0015255 299.5135  40.1876 15.15805287    14

 

05.03.2024 - 15.15 SONATE-2 in stable condition, first day passes completed

After the first two day passes completed today (4 passes in total since deployment), over 1000 telemetry frames have already been downloaded thanks to the successful and robust communication with the satellite. The analyzed housekeeping data show a safe and stable state of the satellite.

 

05.03.2024 - 01.10 End of Stream

The livestream is now offline. Many thanks to all viewers who accompanied us during this exciting mission phase! Further updates on SONATE-2 will follow in the coming days.

 

05.03.2024 - 01.00 SONATE-2 in a healthy condition

The analyses of the first telemetry data show that SONATE-2 is in a healthy state. We are now starting the LEOP procedures.

 

05.03.2024 - 00.27 SONATE-2 received by SatNOGS ground stations

Ground stations of the SatNOGS network have received SONATE-2! Thanks to all operators of SATNOGS stations for their support! Link to SatNOGS DB

 

05.03.2024 - 00.25 Uhr Telemetry is being analyzed!

Screenshot from livestream during first contact with SONATE-2.

Communication with SONATE-2 is stable, initial telemetry data has been received and is being analyzed in the next minutes. The next contact with SONATE-2 is expected at 01:47 (CET)

 

05.03.2024 - 00.15 Uhr First Signal Received

It's official! We have made first contact with our SONATE-2 satellite! We are now starting to analyze the telemetry data received, which shows the status of the satellite.

 

05.03.2024 - 00.03 Uhr Groundstation is awaiting contact

The ground station is ready for operation and pointed in a south-easterly direction, where SONATE-2 will be visible for the first time. Everything is ready for the first contact with SONATE-2 in orbit. First contact is expected around 00:14 (CET) on 05.04.2024.

 

05.03.2024 - 00.01 Uhr Deployment confirmed

The deployment of SONATE-2 into its Sun Synchronous Orbit (SSO) was successful!

 

04.03.2024 - 23.35 Operational plan after deployment:

While we wait for the arrival at the deployment point, some information about the planned actions by SONATE-2 until the first contact attempt:

  • T+0s:   Deployment from Exolaunch Container
  • T+2s:   Boot Onboard Computer
  • T+3min: Deploy Antennas
  • T+4min: Deploy Solar Array
  • T+5min: Start CW Transmission
  • T+15min: First Contact

04.03.2024 - 23.07 Scheduled engine shutdown of the 2nd stage

After the scheduled engine shutdown, the upper stage will fly to the deployment locations. For SONATE-2, this is reached at around 23:59 (CET).

 

04.03.2024 - 23.07 Uhr Stage Seperation

The separation of the Falcon 9 first stage has just been confirmed by SpaceX. The rocket will continue its flight with the second stage up to the S-2 point (separation of the 2nd stage). This is expected to be reached at around 23:59 (CET). So far, everything is going according to plan.

 

04.03.2024 - 23.05 Uhr Lift-Off

LIFT-OFF! The Falcon-9 blasts off from Space Launch Complex 4E in Vandenberg SFB, CA! Have a safe journey SONATE-2!

 

04.03.2024 - 22.55 Uhr T-10 Minutes Countdown Started

Launch preparations for the Transporter-10 mission with SONATE-2 on board are almost complete, the Countdown is ticking! Scheduled launch at (23:05:00 MEZ)

 

04.03.2024 - 22.35 Final preparations for the start are underway

Less than 30 minutes until launch. According to the plan, the rocket is now being fueled and final checks are being carried out.

 

04.03.2024 - 22:28 Uhr Livestream - problems solved

The technical problems in the livestream have been resolved. Thanks to the team in the background.

04.03.2024 - 22:23 Uhr Livestream - smaller technical problems

We are currently experiencing smaller technical issues with our livestream. Our media team is working on a solution at full speed.

 

04.03.2024 - 22:08 Good weather conditions at the launch site

SpaceX has officially confirmed that the current weather conditions at the launch site at Vandenberg Space Force Base are very good.

 

04.03.2024 - 21.30 Uhr Livestream gestartet

The livestream has now officially started! Follow the launch event live on YouTube:https://www.youtube.com/watch?v=4qOBXHmDCUU

Timeline for the stream (Image: T.Neumann)

 

04.03.2024 - 21.05 Uhr The tension is rising!

Less than an two hours left until launch! The image shows SONATE-2 in the Exolaunch deploy container (yellow marker) on the Transporter-10 mission. (Image source: SpaceX)

04.03.2024 - 15.15 Uhr  Planned First Contact Opportunities

Based on the TLE data, the first orbits of SONATE-2 could be simulated including the first possible contact times to our ground station in Würzburg. Further information on the reception of SONATE-2 is summarized on the Information for Radio Amateurs page.(Image: T.Neumann)

 

04.03.2024 - 12.00 Uhr  TLE published

SONATE-2               
1 70309C 24043J   24064.95832326  .00068411  00000+0  35030-2 0    01
2 70309  97.4548 190.2543 0011790 296.9003  44.7014 15.16600872    16

 

04.03.2024 - 10.30 a.m. Livestream URL published

Link to the livestream: https://www.youtube.com/watch?v=4qOBXHmDCUU

Key events (CET):

  • Stream Start 21:30
  • Rocket Launch 23:05
  • Expected first contact: (approx.) 00:15

 

04.03.2024 - 07.30 Uhr a.m. Launch details published by SpaceX - Launch on 04.03.2024 at 23:05 (CET)
SpaceX has published the launch details of the Transporter-10 mission this morning, which will transport SONATE-2 into orbit. The launch will take place today, March 4, 2024 at 23:05 (CET). A first contact attempt with SONATE-2 is expected at approximately 70 minutes after launch.

Link to the SpaceX announcement

 

29.02.2024 SONATE-2: Launch event - livestream announcement

Preparations are underway for the live broadcast of the SONATE-2 launch (Transporter-10 mission). A livestream will cover the entire launch event and provide exclusive insights from the mission control center. Further information on the exact launch date and the link to the livestream will be published here as soon as the official launch date has been announced.

 

26.02.2024 - SONATE-2: Information for radio amateurs

In preparation for the launch, details of SONATE-2 reception for radio amateurs have been published, see here: Information for Radio Amateurs

21.02.2024 - SONATE-2: Test Operations started

 The test operations for SONATE-2 have now started. As of today, the SONATE-2 team is testing the procedures and commands for the safe commissioning of SONATE-2 directly after the launch in a few weeks at the Mission Control Center of the professorship for space technology.

 

20.02.2024 - Liveticker announcement

This live ticker will accompany the SONATE-2 launch. The launch is currently planned for the beginning of March 2024 with transporter mission 10. Exact details on the launch date will be published at the end of February.

The live ticker will accompany the entire launch event. There will also a livestream. Further information will also be published here at the end of February. Check also the german site for additional updates.

 

To top