Dialogue Summaries as Dialogue States (DS2)

Installing the directory as pip will resolve all path issues pip install -e . pip install -r requirements.txt # requires python 3.8 Get MWOZ data (for 2.0 change all 2.1 to 2.0) For 2.0 python scripts/create_data_mwoz.py –mwz_ver=2.0 –main_dir=data_mwoz_2.0 –target_path=data_mwoz_2.0/mwz For 2.1 python scripts/create_data_mwoz.py –mwz_ver=2.1 –main_dir=data_mwoz_2.1 –target_path=data_mwoz_2.1/mwz Training and Inference – Cross-domainPre-trainingExample using T5 on Cross-domain pre-training. Note that this code will not work yet because we did not release our pretrained model checkpoints yet due to anonymity issues. We will […]

Read more

Service for working with open data of the State Duma of the Russian Federation

Исходные данные из API Госдумы РФ извлекаются с помощью Apache Nifi и приземляются в хранилище Clickhouse. Репозиторий состоит из двух частей Data transformation – преобразование данных, приземлённых из API в 3НФ с помощью dbt Telegram бот Архитектура системы GitHub View Github    

Read more