EDS: Eumetsat Data Store
To get access to the Eumetsat data: see: get_apikeys
Some experimental python scripts to download products from Eumetsat.
|text files used in python scripts (defined in eds_defs.py)
|eds.key||replace <consumer_key> and <consumer_secret>|
|eds.prd||example file to store product to download (if needed)|
|python gui product selector
|eds_select.py||select product, add in product file (see get_product() )|
|python scripts: functions
|eds_defs.py||defines variables with default values|
|eds_funcs.py||several functions for downloading||6-8-2021: some bug fixes|
5-10-2022: support no unzip
|python scripts: examples using above functions
|eds_get_in_period.py||Example 1||6-8-2021: Added hour range, minute range
25-1-2022: adapted to allow more flexible ranges
18-9-2022: def. product nr 1 in eds.prd
|eds_get_live.py||Example 2||adapted 5-10-2022: choice not to unzip|
|eds_process.py||contains action to do with downloaded file (used in example 3) |
|18-9-2022: xrit2pic_cmd started explicitely from $HOME/bin instead of just bin
Example 1: download predefined time period and interval
This example downloads zip-files from start_date to end_date, one file for each day, and unzips them.
Example 2: Regularly download new data
A bit like Tellicast, but now using internet.
Define download- and unzip-locations and product to download.
Each 5 minutes a check is done if there is new data available, and if so, download is done.
Example 3: Create a movie with limited time.
By running eds_make_movie.py repeatedly the movie will grow. This depends on the options used with xrit2pic;
in this example the movie will start an midnight and will grow for one day, then start over again.
- Download newest 8 files of a product
- Create a movie using xrit2pic; this is specified in eds_process.py.
This file has some optional arguments:
-h, --help show this help message and exit
-dry just show what will be done
-verbose VERBOSE 0=quiet, 1=errors, 2=+warnings, >2=+info
-nprod NPROD Select product from eds.prd (line nr.)
-product PRODUCT define product name
The Pi to use depends on the processing (i.e., xrit2pic command):
- For processing using single-channel a first generation Pi1 is OK.
- For images genereted using multiple channels a Pi4 with at least 2 GBytes RAM is needed.
This example runs fine on a Pi4 with 8 GBytes RAM, but 4 GB should also work; probably 2 GB should be enough too.
Repeatedly running can best be done by scheduling, e.g. using cron (Linux):
- In a command shell type: crontab -e
- At the bottom you will see:
# m h dom mon dow command
Add a line:
*/5 * * * * python3 eds/eds_make_movie.py >> eds.log
(this is if scripts are in directory $HOME/eds)
This will run the script each day every 5 minutes, needed for RSS. You can change that to:
*/15 * * * * python3 eds/eds_make_movie.py >> eds.log
for MSG (which is updated ecvery 15 minutes). Longer intervals are possible, since 8 new files
can be handled at a time.
Note: If the first line contains:
and if eds_make_movie.py is made executable then you can remove 'python3' in the command.
For easy installation on a py there are some zip-files:
Note: xrit2pic in this zip file runs on a 64-bits PI under Ubuntu 64-bits.
For the Raspberry Pi OS xri2pic would need to be recompiled.
xrit2pic_cmd runs on Ubuntu 64-bits
That's all. Please note:
- Open a command shell and put the zip files at your home directory (probably /home/pi)
- Type unzip eds_install.zip
- This will create a directory eds containing the python files.
- And 2 files eds.key and eds.prd at your home directory.
- In eds.key, using an editor, replace the 2 lines with your Eumetsat consumer key and secret password.
- Type unzip xrit2pic_arm.zip
This will create a directory bin containing xrit2pic_cmd
and a directory lib containing the extra needed 3 libs
- Still being in your home directory type: cp lib/*.so /lib/.
- eds_get_live.py needs extra programs to handle the data.
Running this will fill your disk because it only downloads files, as long as it runs.
- eds_make_movie.py is the only one using xrit2pic_cmd.
This is a ready-to-use script.
Notes if something fails
Files and their places:
If you have problems with tkinter and working on Ubuntu try:
sudo apt-get install python3-tk
- eds/eds_make_movie.py, may be executable
- for xrit2pic_cmd:
- bin/xrit2pic_cmd, must be executable
- /lib/libjpeg812.so, must be executable
- /lib/libwvt.so, must be executable
- /lib/libhdf5.so, must be executable
See also https://realpython.com/python-gui-tkinter