Blizzard Challenge 2023: Difference between revisions

From SynSIG
 
(38 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== Read these first ==
== Read these first ==


* First, please read the [[media: Blizzard2023-CallforParticipation.pdf | Call for Participation in the Blizzard Challenge 2023]] in PDF format (coming soon)
* First, please read the [[media: Blizzard2023-CallforParticipation.pdf | Call for Participation in the Blizzard Challenge 2023]] in PDF format.
* Then, read and agree to the [[Blizzard Challenge 2023 Rules]] before participating
* Then, read and agree to the [[Blizzard Challenge 2023 Rules]] before participating
* You should only register for the challenge if you actually intend to submit an entry to the challenge and to comply with all the rules.
* You should only register for the challenge if you actually intend to submit an entry to the challenge and to comply with all the rules.


The organising committee this year is led by Olivier Perrotin from [http://www.gipsa-lab.fr gipsa-lab] with assistance from The University of Edinburgh.
The organising committee this year is led by [https://scholar.google.com/citations?user=82Az16EAAAAJ Olivier Perrotin] from GIPSA-lab at University Grenoble Alpes, with assistance from Gérard Bailly at GIPSA-lab and Simon King from The University of Edinburgh.


== Registration ==
== Registration ==


Register by emailing blizzard-challenge-organisers@googlegroups.com (note: this is a new address and differs from previous years). We need to know your  
Register by emailing blizzard-challenge-organisers@googlegroups.com ('''''note: this is a new address and differs from previous years'''''). We need to know your:
* preferred team name - ''the organisers may adjust this so that all teams have meaningful, unique names''
* preferred team name - ''the organisers may adjust this so that all teams have meaningful, unique names''
* affiliation - ''the name of your University and lab, or your Company''
* affiliation - ''the name of your University and lab, or your Company''
Line 21: Line 22:
== Data download ==
== Data download ==


TBC
=== Corpus ===
 
Training data with its full description is available here: https://zenodo.org/record/7560290#.Y85YpC_pMzw ‎<br />
:''Last update: 23/01/2023
:: ''Version v2: addition of EC_LFDP_NEB_02_0025 and EC_LFDP_NEB_06_0002 entries in NEB_train.csv)''
‎<br/>
For a one-shot download, you can do in a terminal:
  pip3 install zenodo_get
  zenodo_get 10.5281/zenodo.7560290 -o ~/mylocalrepository -e
 
: ''The -e option prevents the download to stop if there is an error in one file. If this happens, re-launch the command (only the not downloaded files will be downloaded). Full doc [https://gitlab.com/dvolgyes/zenodo_get here].''
‎<br/>
Test data will be released on March 27th to registered participants.


=== Development tools ===
=== Development tools ===


* available via : http://www.cstr.ed.ac.uk/projects/blizzard/, which include submitted synthetic speech and listener scores for some previous Blizzard Challenges, which may be helpful during development
* Available via : http://www.cstr.ed.ac.uk/projects/blizzard/, which include submitted synthetic speech and listener scores for some previous Blizzard Challenges, which may be helpful during development


=== Questionnaire ===
=== Questionnaire ===


* A questionnaire is included with the test materials. Please complete and include it within your submission.
* A questionnaire is included with the test materials. Please complete and include it within your submission.
=== Test set ===
Hub task 2023-FH1: https://cloud.univ-grenoble-alpes.fr/s/56fxarXHe3G9RrG
Spoke task 2023-FS1: https://cloud.univ-grenoble-alpes.fr/s/ogAdpngxGxNJKAn


== Mailing list ==
== Mailing list ==
Line 40: Line 59:


== Timeline ==
== Timeline ==
The timeline shown on this web page is VERY preliminary and subject to change.


   Jan 13    2023 - challenge announcement and registration open
   Jan 13    2023 - challenge announcement and registration open
Line 50: Line 67:
   Apr 07    2023 - last date for payment of the entry fee
   Apr 07    2023 - last date for payment of the entry fee
   Apr 17    2023 - evaluation systems go live
   Apr 17    2023 - evaluation systems go live
   Jun 04    2023 - end of the evaluation period
   Jun 12    2023 <s>Jun 04    2023</s> - end of the evaluation period
   Jun 16    2023 - release of results
   Jun 22    2023 <s>Jun 16    2023</s> - release of results
   Jul 03    2023 - deadline to submit workshop papers (23:59 AoE)
   Jul 10    2023 <s>Jul 03    2023</s> - deadline to submit workshop papers (23:59 AoE)
   Jul 28    2023 - notification of acceptance
   Jul 28    2023 - notification of acceptance
   Aug 20-24 2023 - [https://www.interspeech2023.org INTERSPEECH 2023], Dublin, Ireland
   Aug 20-24 2023 - [https://www.interspeech2023.org INTERSPEECH 2023], Dublin, Ireland
   Aug 26-28 2023 - [https://ssw2023.org SSW12], Grenoble, France  
   Aug 26-28 2023 - [https://ssw2023.org SSW12], Grenoble, France  
   Aug 29    2023 - Blizzard Challenge 2023 Workshop, same location as SSW
   Aug 29    2023 - Blizzard Challenge 2023 Workshop, same location as SSW
Announcement and registration Friday 13 January 2023
DB release Friday 13 January 2023
Registration close Sunday 5 March 2023
Test sentences release Monday 27 March 2023
Submission synthesis Monday 3 April 2023
Payment Friday 7 April 2023
Evaluation open Monday 17 April 2023
Evaluation close Sunday 4 June 2023
Results release Friday 16 June 2023
Paper deadline Monday 3 July 2023
Notification acceptance Friday 28 July 2023
Workshop Tuesday 29 August 2023


== Workshop ==
== Workshop ==


Information on the workshop can be found here: [[Blizzard Challenge 2021 Workshop]]
Information on the workshop can be found here: [[Blizzard Challenge 2023 Workshop]]


== Any questions? ==
== Any questions? ==


* Please contact blizzard@festvox.org if you have any questions
Please contact blizzard-challenge-organisers@googlegroups.com if you have any questions.


== Previous challenges ==
== Previous challenges ==

Latest revision as of 15:35, 29 September 2023

Read these first

The organising committee this year is led by Olivier Perrotin from GIPSA-lab at University Grenoble Alpes, with assistance from Gérard Bailly at GIPSA-lab and Simon King from The University of Edinburgh.

Registration

Register by emailing blizzard-challenge-organisers@googlegroups.com (note: this is a new address and differs from previous years). We need to know your:

  • preferred team name - the organisers may adjust this so that all teams have meaningful, unique names
  • affiliation - the name of your University and lab, or your Company
  • the name of the main contact person - this must be exactly one person who is responsible for all communication with the organiser
  • contact details:
    • main contact person's email address - should be an institutional email address
    • backup email address(es)
    • postal address
    • phone number

Data download

Corpus

Training data with its full description is available here: https://zenodo.org/record/7560290#.Y85YpC_pMzw ‎

Last update: 23/01/2023
Version v2: addition of EC_LFDP_NEB_02_0025 and EC_LFDP_NEB_06_0002 entries in NEB_train.csv)

‎
For a one-shot download, you can do in a terminal: 

 pip3 install zenodo_get
 zenodo_get 10.5281/zenodo.7560290 -o ~/mylocalrepository -e
The -e option prevents the download to stop if there is an error in one file. If this happens, re-launch the command (only the not downloaded files will be downloaded). Full doc here.

‎
Test data will be released on March 27th to registered participants.

Development tools

Questionnaire

  • A questionnaire is included with the test materials. Please complete and include it within your submission.

Test set

Hub task 2023-FH1: https://cloud.univ-grenoble-alpes.fr/s/56fxarXHe3G9RrG

Spoke task 2023-FS1: https://cloud.univ-grenoble-alpes.fr/s/ogAdpngxGxNJKAn

Mailing list

There is a Google Group for discussion and announcements for the challenge: 

 https://groups.google.com/g/blizzard-challenge-discuss/

Participants must join this group in order to receive information about the Challenge. You need to log in to a Google account, then request to join. If you do not have a Google account, you will need to create one.

Timeline

  Jan 13    2023 - challenge announcement and registration open
  Jan 13    2023 - database released
  Mar 05    2023 - team registration closes
  Mar 27    2023 - test sentences released to participants
  Apr 03    2023 - deadline for participants to submit synthetic speech (23:59 AoE)
  Apr 07    2023 - last date for payment of the entry fee
  Apr 17    2023 - evaluation systems go live
  Jun 12    2023 Jun 04    2023 - end of the evaluation period
  Jun 22    2023 Jun 16    2023 - release of results
  Jul 10    2023 Jul 03    2023 - deadline to submit workshop papers (23:59 AoE)
  Jul 28    2023 - notification of acceptance
  Aug 20-24 2023 - INTERSPEECH 2023, Dublin, Ireland
  Aug 26-28 2023 - SSW12, Grenoble, France 
  Aug 29    2023 - Blizzard Challenge 2023 Workshop, same location as SSW

Workshop

Information on the workshop can be found here: Blizzard Challenge 2023 Workshop

Any questions?

Please contact blizzard-challenge-organisers@googlegroups.com if you have any questions.

Previous challenges

Retrieved from "http://synsig.it.helsinki.fi/index.php?title=Blizzard_Challenge_2023&oldid=3116"