ECMWF (IFS and AIFS) — Herbie 2024.3.1.post69 documentation (2024)

[9]:

H = Herbie("2024-03-1", model="ifs", product="oper", fxx=12)H.grib, H.idx

✅ Found ┊ model=ifs ┊ product=oper ┊ 2024-Mar-01 00:00 UTC F12 ┊ GRIB2 @ azure ┊ IDX @ azure

[9]:

('https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/ifs/0p25/oper/20240301000000-12h-oper-fc.grib2', 'https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/ifs/0p25/oper/20240301000000-12h-oper-fc.index')

[10]:

# Show the inventoryH.inventory()

[10]:

83 rows × 17 columns

[14]:

# Show just 10-m U and V windH.inventory(":10[u|v]:")

[14]:

[16]:

# Get 2-m temperature as an xarray Datasetds = H.xarray(":2t:", verbose=True)ds

📇 Download subset: ▌▌Herbie IFS model oper product initialized 2024-Mar-01 00:00 UTC F12 ┊ source=azure cURL from https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/ifs/0p25/oper/20240301000000-12h-oper-fc.grib2Found 1 grib messages.Download subset group 1 41 :2t:sfc:g:0001:od:fc:opercurl -s --range 24427114-25090915 "https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/ifs/0p25/oper/20240301000000-12h-oper-fc.grib2" > "/home/blaylock/data/ifs/20240301/subset_e0127a9f__20240301000000-12h-oper-fc.grib2"💾 Saved the subset to /home/blaylock/data/ifs/20240301/subset_e0127a9f__20240301000000-12h-oper-fc.grib2

[16]:

<xarray.Dataset>Dimensions: (latitude: 721, longitude: 1440)Coordinates: time datetime64[ns] 2024-03-01 step timedelta64[ns] 12:00:00 heightAboveGround float64 2.0 * latitude (latitude) float64 90.0 89.75 89.5 ... -89.75 -90.0 * longitude (longitude) float64 -180.0 -179.8 ... 179.5 179.8 valid_time datetime64[ns] 2024-03-01T12:00:00Data variables: t2m (latitude, longitude) float32 244.9 244.9 ... 224.6 gribfile_projection object NoneAttributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: oper description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20240301/subset_e0127a9f... searchString: :2t:

[18]:

ds.t2m.plot()

[18]:

<matplotlib.collections.QuadMesh at 0x7f69148055b0>

[22]:

H = Herbie("2024-03-1", model="ifs", product="oper", fxx=12)# Show the searchString_helpprint(H.searchString_help)

✅ Found ┊ model=ifs ┊ product=oper ┊ 2024-Mar-01 00:00 UTC F12 ┊ GRIB2 @ azure ┊ IDX @ azureUse regular expression to search for lines in the index file.Here are some examples you can use for the ecCodes-style `searchString`Look at the ECMWF GRIB Parameter Databasehttps://apps.ecmwf.int/codes/grib/param-db======================== ==============================================searchString (oper/enso) Messages that will be downloaded======================== ==============================================":2t:" 2-m temperature":10u:" 10-m u wind vector":10v:" 10-m v wind vector":10(u|v): **10m u and 10m v wind**":d:" Divergence (all levels)":gh:" geopotential height (all levels)":gh:500" geopotential height only at 500 hPa":st:" soil temperature":tp:" total precipitation":msl:" mean sea level pressure":q:" Specific Humidity":r:" relative humidity":ro:" Runn-off":skt:" skin temperature":sp:" surface pressure":t:" temperature":tcwv:" Total column vertically integrated water vapor":vo:" Relative vorticity":v:" v wind vector":u:" u wind vector":(t|u|v|r):" Temp, u/v wind, RH (all levels)":500:" All variables on the 500 hPa level======================== ==============================================searchString (wave/waef) Messages that will be downloaded======================== ==============================================":swh:" Significant height of wind waves + swell":mwp:" Mean wave period":mwd:" Mean wave direction":pp1d:" Peak wave period":mp2:" Mean zero-crossing wave periodIf you need help with regular expression, search the web or look atthis cheatsheet: https://www.petefreitag.com/cheatsheets/regex/.

[23]:

H.inventory()

[23]:

83 rows × 17 columns

[24]:

ds = H.xarray(":2t:")ds

[24]:

<xarray.Dataset>Dimensions: (latitude: 721, longitude: 1440)Coordinates: time datetime64[ns] 2024-03-01 step timedelta64[ns] 12:00:00 heightAboveGround float64 2.0 * latitude (latitude) float64 90.0 89.75 89.5 ... -89.75 -90.0 * longitude (longitude) float64 -180.0 -179.8 ... 179.5 179.8 valid_time datetime64[ns] 2024-03-01T12:00:00Data variables: t2m (latitude, longitude) float32 244.9 244.9 ... 224.6 gribfile_projection object NoneAttributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: oper description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20240301/subset_e0127a9f... searchString: :2t:

[25]:

ax = EasyMap("50m", crs=ds.herbie.crs, figsize=[10, 10]).STATES().BORDERS().axp = ax.pcolormesh( ds.longitude, ds.latitude, ds.t2m, transform=pc, **cm_tmp(units="K").cmap_kwargs)plt.colorbar( p, ax=ax, orientation="horizontal", pad=0.05, **cm_tmp(units="K").cbar_kwargs)ax.set_title( f"{ds.model.upper()}: {H.product_description}\nValid: {ds.valid_time.dt.strftime('%H:%M UTC %d %b %Y').item()}", loc="left",)ax.set_title(ds.t2m.GRIB_name, loc="right")

[25]:

Text(1.0, 1.0, '2 metre temperature')

[27]:

H = Herbie("2024-03-01", model="ifs", product="oper")# Get u and v wind componentds = H.xarray(":10[u|v]:")# Compute the wind speedds["spd"] = np.sqrt(ds["u10"] ** 2 + ds["v10"] ** 2)# without too much thought, just quickly copy attributesds["spd"].attrs = ds["u10"].attrs.copy()ds["spd"].attrs["standard_name"] = "wind_speed"ds["spd"].attrs["long_name"] = "10 m wind speed"ds["spd"].attrs["GRIB_name"] = "10 m Wind Speed"ds

✅ Found ┊ model=ifs ┊ product=oper ┊ 2024-Mar-01 00:00 UTC F00 ┊ GRIB2 @ azure ┊ IDX @ azure

[27]:

<xarray.Dataset>Dimensions: (latitude: 721, longitude: 1440)Coordinates: time datetime64[ns] 2024-03-01 step timedelta64[ns] 00:00:00 heightAboveGround float64 10.0 * latitude (latitude) float64 90.0 89.75 89.5 ... -89.75 -90.0 * longitude (longitude) float64 -180.0 -179.8 ... 179.5 179.8 valid_time datetime64[ns] 2024-03-01Data variables: u10 (latitude, longitude) float32 1.654 1.654 ... -1.237 v10 (latitude, longitude) float32 0.9546 0.9546 ... 2.361 gribfile_projection object None spd (latitude, longitude) float32 1.909 1.909 ... 2.665Attributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: oper description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20240301/subset_e0ef1f8f... searchString: :10[u|v]:

[28]:

ax = EasyMap("50m", crs=ds.herbie.crs, figsize=[10, 10]).STATES().BORDERS().axp = ax.pcolormesh( ds.longitude, ds.latitude, ds.spd, transform=pc, **cm_wind().cmap_kwargs)plt.colorbar(p, ax=ax, orientation="horizontal", pad=0.05, **cm_wind().cbar_kwargs)ax.set_title( f"{ds.model.upper()}: {H.product_description}\nValid: {ds.valid_time.dt.strftime('%H:%M UTC %d %b %Y').item()}", loc="left",)ax.set_title(ds.spd.GRIB_name, loc="right")

[28]:

Text(1.0, 1.0, '10 m Wind Speed')

[29]:

ds = H.xarray(":(?:q|gh):500")ds

[29]:

<xarray.Dataset>Dimensions: (latitude: 721, longitude: 1440)Coordinates: time datetime64[ns] 2024-03-01 step timedelta64[ns] 00:00:00 isobaricInhPa float64 500.0 * latitude (latitude) float64 90.0 89.75 89.5 ... -89.75 -90.0 * longitude (longitude) float64 -180.0 -179.8 ... 179.5 179.8 valid_time datetime64[ns] 2024-03-01Data variables: q (latitude, longitude) float32 0.0001736 ... 0.0001869 gh (latitude, longitude) float32 5.196e+03 ... 4.895e+03 gribfile_projection object NoneAttributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: oper description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20240301/subset_e0efbf07... searchString: :(?:q|gh):500

[30]:

ax = EasyMap("50m", crs=ccrs.Robinson(), figsize=[10, 10]).STATES().BORDERS().ax# Color shade by specific humidityp = ax.pcolormesh(ds.longitude, ds.latitude, ds.q, transform=pc, cmap="Greens")plt.colorbar( p, ax=ax, orientation="horizontal", pad=0.05, label=f"{ds.q.GRIB_name} ({ds.q.units})",)# Contours for geopotential heightax.contour( ds.longitude, ds.latitude, ds.gh, transform=pc, colors="k", linewidths=0.5, levels=range(0, 10_000, 60 * 2),)ax.set_title( f"{ds.model.upper()}: {H.product_description}\nValid: {ds.valid_time.dt.strftime('%H:%M UTC %d %b %Y').item()}", loc="left",)ax.set_title( f"{ds.isobaricInhPa.item()} {ds.isobaricInhPa.units}\n{ds.q.GRIB_name}/{ds.gh.GRIB_name}", loc="right",)

[30]:

Text(1.0, 1.0, '500.0 hPa\nSpecific humidity/Geopotential height')

[31]:

H = Herbie("2022-01-26 00:00", model="ifs", product="wave")

✅ Found ┊ model=ifs ┊ product=wave ┊ 2022-Jan-26 00:00 UTC F00 ┊ GRIB2 @ azure ┊ IDX @ azure

[32]:

ds = H.xarray(None, verbose=True)ds

/home/blaylock/GITHUB/Herbie/herbie/core.py:1101: UserWarning: Will not remove GRIB file because Herbie will only remove subsetted files (not full files). warnings.warn(

👨🏻‍🏭 Created directory: [/home/blaylock/data/ifs/20220126]✅ Success! Downloaded IFS from azure  src: https://ai4edataeuwest.blob.core.windows.net/ecmwf/20220126/00z/0p4-beta/wave/20220126000000-0h-wave-fc.grib2 dst: /home/blaylock/data/ifs/20220126/20220126000000-0h-wave-fc.grib2

[32]:

<xarray.Dataset>Dimensions: (latitude: 451, longitude: 900)Coordinates: time datetime64[ns] 2022-01-26 step timedelta64[ns] 00:00:00 meanSea float64 0.0 * latitude (latitude) float64 90.0 89.6 89.2 ... -89.2 -89.6 -90.0 * longitude (longitude) float64 -180.0 -179.6 ... 179.2 179.6 valid_time datetime64[ns] 2022-01-26Data variables: mp2 (latitude, longitude) float32 ... swh (latitude, longitude) float32 ... mwd (latitude, longitude) float32 ... pp1d (latitude, longitude) float32 ... mwp (latitude, longitude) float32 ... gribfile_projection object NoneAttributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: wave description: ECMWF Open Data - Integrated Forecast System remote_grib: /home/blaylock/data/ifs/20220126/20220126000000-... local_grib: /home/blaylock/data/ifs/20220126/20220126000000-... searchString: None

[33]:

ax = EasyMap("50m", crs=ds.herbie.crs, figsize=[10, 10]).STATES().BORDERS().axp = ax.pcolormesh( ds.longitude, ds.latitude, ds.swh, transform=pc, **cm_wave_height(units="m").cmap_kwargs,)plt.colorbar( p, ax=ax, orientation="horizontal", pad=0.05, **cm_wave_height(units="m").cbar_kwargs,)ax.set_title( f"{ds.model.upper()}: {H.product_description}\nValid: {ds.valid_time.dt.strftime('%H:%M UTC %d %b %Y').item()}", loc="left",)ax.set_title(ds.swh.GRIB_name, loc="right")

[33]:

Text(1.0, 1.0, 'Significant height of combined wind waves and swell')

[24]:

H = Herbie("2022-01-26 00:00", model="ifs", product="enfo")ds = H.xarray(":2t:")ds

/tmp/ipykernel_16619/1920808957.py:1: DeprecationWarning: `model='ecmwf'`is deprecated. Please use model='ifs' instead. Also, did you know you can also access `model='aifs'` too! H = Herbie("2022-01-26 00:00", model="ecmwf", product="enfo")

✅ Found ┊ model=ifs ┊ product=enfo ┊ 2022-Jan-26 00:00 UTC F00 ┊ GRIB2 @ azure ┊ IDX @ azureNote: Returning a list of [2] xarray.Datasets because cfgrib opened with multiple hypercubes.

[24]:

[<xarray.Dataset> Dimensions: (number: 50, latitude: 451, longitude: 900) Coordinates: * number (number) int64 1 2 3 4 5 6 7 8 ... 44 45 46 47 48 49 50 time datetime64[ns] 2022-01-26 step timedelta64[ns] 00:00:00 heightAboveGround float64 2.0 * latitude (latitude) float64 90.0 89.6 89.2 ... -89.2 -89.6 -90.0 * longitude (longitude) float64 -180.0 -179.6 ... 179.2 179.6 valid_time datetime64[ns] 2022-01-26 Data variables: t2m (number, latitude, longitude) float32 246.5 ... 246.2 gribfile_projection object None Attributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: enfo description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20220126/subset_bfef7f9f... searchString: :2t:, <xarray.Dataset> Dimensions: (latitude: 451, longitude: 900) Coordinates: number int64 0 time datetime64[ns] 2022-01-26 step timedelta64[ns] 00:00:00 heightAboveGround float64 2.0 * latitude (latitude) float64 90.0 89.6 89.2 ... -89.2 -89.6 -90.0 * longitude (longitude) float64 -180.0 -179.6 ... 179.2 179.6 valid_time datetime64[ns] 2022-01-26 Data variables: t2m (latitude, longitude) float32 246.2 246.2 ... 246.3 gribfile_projection object None Attributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: ifs product: enfo description: ECMWF Open Data - Integrated Forecast System remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/ifs/20220126/subset_bfef7f9f... searchString: :2t:]

[ ]:

# Dataset with all 50 membersds[0]

[ ]:

# This Dataset is of the mean of all the members, right?ds[1]

[ ]:

H.idx

[ ]:

H = Herbie("2022-01-26 00:00", model="ecmwf", product="waef")ds = H.xarray(None)ds

[ ]:

len(ds)

[ ]:

ds[0]

[ ]:

ds[1]

[ ]:

H = Herbie("2022-01-26", model="ecmwf", product="enfo")H.inventory()

[ ]:

[ ]:

H = Herbie("2022-01-26", model="ecmwf", product="oper", fxx=12)

[ ]:

# Download the full grib2 fileH.download()

[ ]:

# Download just the 10-m u and v windsH.download(searchString=":10(u|v):")

[ ]:

# Retrieve the 500 hPa temperature as an xarray.Datasetds = H.xarray(searchString=":t:500:")

[ ]:

ds

[ ]:

ds.t.plot()

[2]:

H = Herbie("2024-03-1", model="aifs", product="oper", fxx=12)H.grib, H.idx

✅ Found ┊ model=aifs ┊ product=oper ┊ 2024-Mar-01 00:00 UTC F12 ┊ GRIB2 @ azure ┊ IDX @ azure

[2]:

('https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/aifs/0p25/oper/20240301000000-12h-oper-fc.grib2', 'https://ai4edataeuwest.blob.core.windows.net/ecmwf/20240301/00z/aifs/0p25/oper/20240301000000-12h-oper-fc.index')

[3]:

H.inventory(":t:850")

[3]:

[4]:

ds = H.xarray(":t:850")ds

[4]:

<xarray.Dataset>Dimensions: (values: 542080)Coordinates: time datetime64[ns] 2024-03-01 step timedelta64[ns] 12:00:00 isobaricInhPa float64 850.0 latitude (values) float64 89.78 89.78 89.78 ... -89.78 -89.78 longitude (values) float64 0.0 20.0 40.0 ... 300.0 320.0 340.0 valid_time datetime64[ns] 2024-03-01T12:00:00Dimensions without coordinates: valuesData variables: t (values) float32 251.8 251.9 252.1 ... 241.6 241.8 gribfile_projection object NoneAttributes: GRIB_edition: 2 GRIB_centre: ecmf GRIB_centreDescription: European Centre for Medium-Range Weather Forecasts GRIB_subCentre: 0 Conventions: CF-1.7 institution: European Centre for Medium-Range Weather Forecasts model: aifs product: oper description: ECMWF Open Data - Artificial Inteligence Integra... remote_grib: https://ai4edataeuwest.blob.core.windows.net/ecm... local_grib: /home/blaylock/data/aifs/20240301/subset_e012fc9... searchString: :t:850

[6]:

import matplotlib.pyplot as pltds_thinned = ds.thin(50)plt.scatter(ds_thinned.longitude, ds_thinned.latitude, c=ds_thinned.t, marker=".")

[6]:

<matplotlib.collections.PathCollection at 0x7fadeed782f0>