In this video we present how datasets and policies can be stored and retrieved in AI4PublicPolicy. This can be achieved through the Data Management Toolkit (web interface or the REST API), developed within the framework of the project by our partners from Universidad Politécnica de Madrid.

About the Dataset and Policy Management

All policies defined in AI4PublicPolicy are associated with one or more datasets. these datasets are produced by different types of sources, generating data in different types of formats like csv, json or images and in different languages, such as English, Greek or Italian. The datasets and policies are stored in a remote file system used in AI4PublicPolicy that provides a centralized repository for datasets storage, the EGI OneData.

​​The web interface of the Data Management Toolkit is suitable for non-technical users, who can view the registered policies and datasets and define new ones that correspond to five different areas according to the AI4PublicPolicy pilots:

• Policies for the optimal allocation of maintenance resources
• Policies for parking space management and urban mobility
• Policies for citizens and businesses services optimisation
• Policies for energy management
• Policies for water infrastructure planning and maintenance

The web interface invokes the operations using the REST APIs for the datasets and policies. Some of the other technical components developed in AI4PublicPolicy also use these interfaces for processing data and policies.

Interactions with the Dataset and Policy Management Component

In the video we present the possible interactions with the Dataset and Policy Management component through the web interface. Firstly, a list of the available datasets and how datasets are defined is presented. Then, the uploading of a dataset file, using the web interface and directly through the EGI OneData is demonstrated, along with how the files uploaded are available. Finally, the definition of a new policy is presented, as well as the list of available policies.

The video proceeds to demonstrate how the datasets are defined in the system, i.e., (i) how the area of interest among the five available must be selected, (ii) how the datasets are listed, (iii) how the data format and language for each dataset is described and (iv) how clicking on a dataset displays the available files. Once the dataset has been defined, it is possible to upload files. To do so, the area and the dataset to which the file will belong and the endpoint where it is available must be selected. Then, the file that has been uploaded at EGI OneData can be viewed. It is also possible to upload a file through EGI OneData interface, selecting the folder of the area and within this the folder of the dataset where the data needs to be uploaded. These new files appear automatically in the web application. Finally, to define a new policy, the policy must be associated to an area, KPIs and other metadata of a policy. The policies are listed in the policies tab and grouped according to the area they belong to.