Open Weather

Open Weather


A next-generation Big Data weather database and Web Service engine to publish your weather data through the power of open standard OGC protocols. Unleash the power of the Clouds to handle large weather data volumes.

Why choose Open Weather

In today's data-driven world, weather information is essential for countless industries and applications. Whether you're building a weather app, optimizing weather dependent operations, accurate and reliable weather data is invaluable. Open Weather is your go-to solution for all your weather data processing needs.

With a vast array of data points, including current conditions, forecasts, historical data, and specialized information like air quality and marine forecasts, Open Weather provides the comprehensive weather intelligence you need:

Modern satellites with high-resolution rapid scans deliver Terabytes of imagery daily
Weather models with increased resolution, nested domains, ensembles generate hundreds of Terabytes to Petabytes of multi-dimensional data per day
Taking advantage of the elasticity of the Cloud to provide weather data to public or to private users in a highly timely manner

Large volumes of data

Open Weather excels at handling the immense volume and complexity of weather data. It efficiently processes vast datasets from diverse sources like satellites and high-resolution models. The platform's robust infrastructure, including hybrid client technology and super cache, ensures seamless data management and rapid retrieval. This allows users to access and analyze large quantities of weather information quickly and effectively, supporting a wide range of applications from weather forecasting to climate research.

Open standards

Open Weather leverages open standards to ensure seamless data exchange and accessibility. By adhering to protocols like OpenGIS Web Coverage Service (WCS) and the Environmental Data Retrieval (EDR) API, Open Weather provides a standardized framework for publishing and accessing diverse weather data. This promotes interoperability, allowing users to easily integrate weather information into their systems and applications, fostering innovation and collaboration within the meteorological community.

Scalability

Open Weather harnesses the power of cloud computing on platforms like Amazon AWS, to achieve unparalleled scalability. By adopting a serverless architecture, Open Weather dynamically adjusts its resources to handle fluctuating data volumes and user demands. This cloud-based approach allows for rapid scaling to accommodate growing data sets and increasing user numbers. As a result, IBL Open Weather can deliver high performance and reliability while optimizing costs and maintaining flexibility.

Cloud-native or on-premise

Open Weather is a product for the cloud era, thus achieving scalability using technologies such as autoscaling groups and serverless lambda functions. At the same time, its design also allows for scaling down, enabling efficient operation in a more traditional on-premise environment.

But Open Weather's reach extends beyond a single cloud environment. It's cloud-agnostic, capable of functioning optimally within AWS, Azure, or even private data centres powered by OpenStack.

Open Weather’s architecture is specifically designed to process immense volumes of data and meanwhile capable of scaling up to meet the needs of millions of users.

Open Weather Editions

Open Weather offers a range of editions to cater to the diverse needs of our customers. Each edition provides a specific set of features and data points, ensuring you get the right level of weather information for your application.

Community edition

Free software for enthusiasts, simple to deploy to process weather formats locally or connect to other Open Weather systems!
Try Free in Docker
Local GRIB and NetCDF ingestion
Grid Elastic Database client
Object Elastic Database client
Remote Imagery and Model Access (RIMA) API
Python Web Services
Python API

Standard edition

Publish and provide weather data through web services or create custom added-value web API!
Ask for consultancy
Local GRIB and NetCDF ingestion
Grid Elastic Database client
Object Elastic Database client
Python Web Services
Remote Imagery and Model Access (RIMA) API
Python API
OpenGIS Environmental Data Retrieval (EDR) API
OpenGIS Web Processing Service 1.0 (WPS)
OpenGIS Web Coverage Service 2.1 (WCS) MetOcean extension

Enterprise edition

Publish and provide weather data through web services or create custom added-value web API!
Ask for consultancy
GRIB and NetCDF ingestion into Grid Elastic Database
Ingestion of point observations or other spatial objects into Object Elastic Database
Python Web Services
Remote Imagery and Model Access (RIMA) API
Grid Elastic Database and Object Elastic Database clients
Python API
OpenGIS Web Coverage Service 2.1 (WCS) MetOcean extension API
OpenGIS Environmental Data Retrieval (EDR) API
OpenGIS Web Map Service 1.3 (WMS) Time and Elevation best practice
OpenGIS Web Processing Service 1.0 (WPS)
Automated creation of lagged ensembles, user drive virtual ensembles
Enterprise SLA support

Open Weather Components

Grid Elastic Database

Open Weather intelligently grid stores data in the Grid Elastic Database, designed to store large data volumes while allowing for efficient data queries.
Gridded weather data is typically provided to Open Weather in:
  • GRIB
  • NetCDF
  • HDF5 or similar formats.
In a process called "Shredding," the Grid Elastic Database builds structures of tiles from the gridded data to facilitate optimal access to different levels of resolution or time series. This restructuring of data is the key aspect contributing to optimal data retrieval for various spatial or temporal query patterns, such as subsetting spatially to provide data views at various levels of zoom, extracting vertical cross-section profiles, or extracting time-cross sections.
 

Enhancing models with diagnostics and custom algoritms

Grid Elastic Database (GED) serves not only as a repository for existing ingested grids, but it also has the capability to generate added value products. In parallel to the Field Diagnostics functionality provided by Visual Weather, GED enables the computation of derived grid fields. This functionality enhances the database's utility, allowing users to extract further insights and develop more sophisticated analyses from their grid data.

There are 2 modes of computing derived grid fields.

  • on demand when any client requests a specific derived field (where resulting fields are cached within the GED)
  • in batch mode, right after source fields get ingested (where resulting fields are regularly stored within the GED)

These computations are not limited to NWP or ensemble models; any grids, including satellite or radar imagery, can be input for these computations.

Overall, for end users—for example, when accessing GED through EDR web services—all computed derived fields can be accessed as seamlessly as all other native grid fields.

Enhancing ensemble models

Grid Elastic Database offers advanced interrogation tools for ensemble models, placing the power of cutting-edge weather forecasting in the hands of skilled users. With these features, users can effectively analyze and modify ensemble datasets, paving the way for more accurate and insightful predictions. As ensemble models continue to shape the future of weather forecasting,  Open Weather equips users with the necessary tools to stay at the forefront of meteorological advancements. 

Power users of Open Weather can take advantage of these advanced features, and reveal valuable details from ensemble models:

  • explore ensemble fields statistical distribution;
  • apply custom data diagnostics;
  • create virtual models;
  • create lagged ensembles;

 

  • rank subsets of ensembles;
  • or even collate super ensembles of ensembles.

Object Elastic Database

Point observations or polygon objects, such as weather warning areas, can efficiently stored in the Object Elastic Database (OED). This database is specially designed to handle large quantities of point-based or polygon- based weather data, allowing weather services to effectively manage and query location-specific information in space and in time.

Object Elastic Database supports natively a variety of input formats: 

  • XML/IWXXM, JSON, CSV,  etc.
  • any format integrated using Visual Weather's GATE interface
  • New formats can be added by implementing dataset decoders in Python

Creating derived object datasets

The Object Elastic Database (OED) features the Collection Processor, designed to seamlessly handle complex datasets by responding to notifications about their updates and creating new post-processed datasets. For example, from a source database containing near real-time lightning observations, the Collection Processor can create a dataset with 5-minute summaries, aggregating all lightning observations for that period. This aggregated data may be more useful for some downstream applications.

 

The Collection Processor operates as a periodically triggered service function, efficiently managing data processing in a stateful manner. With its ability to store a resume token for continuous data processing, this service function ensures uninterrupted operation even in dynamic environments. Configurable to run with a single instance, it optimises concurrency and guarantees consistent processing without redundancy.

 

Using same process Object Processor can monitor specific datasets for incoming real-time observations and derive a new dataset with alert objects, which are created when a source observation triggers warning or critical alerts. Developers can implement any kind of algorithm, including Machine Learning, to transform source objects into new objects. In reference to the previous example with lightning, incoming lightning observations can be collected and turned into polygonal objects depicting alert areas where lightning is active.

APIs and Web Services

The primary output of Open Weather are Web Services and APIs. With Open Weather, your data will be available in a wide variety of standard outputs and protocols, including:

  • OGC Environmental Data Retrieval (EDR) API, which is an OpenAPI based RESTful API 
  • OGC Web Map Service (WMS), OGC Web Coverage Service (WCS), OGC Web Feature Service (WFS) 1.0, 1.1
  • or custom web services implemented in Python

Through these, the Open Weather provides the ability to slice and dice data across varying geographic ranges, facilitating polygonal extractions and even complex 4D (space and time) trajectory extractions. One can also perform intelligent data resampling and vertical and temporal interpolations. This ensures that weather data isn't just comprehensive but is also finely tuned to user's precise needs and context.

Expertise from Customer Base

Open Weather is used by organisations worldwide. Its development is based on long-term cooperation and the expertise of this customer base. We even meet up annually at our User Group Meeting.
Join UGM

Legendary Support

Our support is the most valued service and  our team of experts is available 24/7 to fix critical issues, upgrade your systems and provide advice. Prompt and useful support is an essential part of our products.
Contact support

Do You Want to Know More?

Send an mail to sales@iblsoft.com to get more information about Online Weather. We will prepare a proposal for handling weather data within your organisation based on your needs
Contact sales
© 2005 – 2024 IBL Software Engineering. All Rights Reserved.
Webdesign by Art4web. Development by YNK media.