Blizzard Challenge 2012: Difference between revisions

From SynSIG
No edit summary
 
(34 intermediate revisions by the same user not shown)
Line 1: Line 1:
[[Image:Toshiba logo 264x76 europe.gif||frame|Data for the Blizzard Challenge 2012 was generously provided by Toshiba Research Europe Ltd, Cambridge Research Laboratory http://www.toshiba-europe.com/research/crl/index.html]]
[[Image:Toshiba logo 264x76 europe.gif||frame|Data for the Blizzard Challenge 2012 was generously provided by Toshiba Research Europe Ltd, Cambridge Research Laboratory http://www.toshiba-europe.com/research/crl/index.html]]
[[image:Google_logo.JPG||frame|Google UK has generously provided financial support to the Blizzard Challenge 2012]]
<br />
<br />
== This Blizzard Challenge has finished ==
* Please do not try to register for this challenge - you are too late!
* However, the data are still available. Do not email us, but simply go to https://synsig.org/index.php/Blizzard_Challenge#Tools_and_data
* The remainder of this page is left as a record of the Challenge


== Read these first ==
== Read these first ==


* Note that this page is for the Blizzard Challenge 2012, which runs over two years. Phase One of the Blizzard Challenge 2012 runs in parallel with the [[Blizzard Challenge 2011]]
This challenge is organised in two phases. Phase 1 was a preliminary phase run during 2011. Phase 2 is the main phase and is now running. You may still register for Phase 2, even if you didn't participate in Phase 1.


* Download the [[media:Blizzard2012_phase_one.pdf | Call for Participation in Phase One of the Blizzard Challenge 2012]] in PDF format.
* Phase 1
 
** This is now completed.
* Read and agree to the [[Blizzard Challenge 2012 Rules]] before participating.
** You can still read the [[media:Blizzard2012_phase_one.pdf | Call for Participation in Phase One of the Blizzard Challenge 2012]] in PDF format.
* Phase 2
** First, please read the [[media:Blizzard2012_phase_two.pdf | Call for Participation in Phase Two of the Blizzard Challenge 2012]] in PDF format.
** Then read and agree to the [[Blizzard Challenge 2012 Rules]] before participating
* You should only register for the challenge and download the data if you plan to submit an entry to the challenge in 2012.


== Data download and license agreements ==
== Data download and license agreements ==
# Register: by emailing blizzard@festvox.org
# Register: by emailing blizzard@festvox.org. We need to know your team name, the name of the main contact person, your affiliation, and contact details including email address, postal address and phone number.
# License: complete the license agreement for the data, which can be accessed via http://www.cstr.ed.ac.uk/projects/blizzard/
# License: complete the license agreement for the data, which can be accessed via http://www.cstr.ed.ac.uk/projects/blizzard/
# Download: You will be sent a username and password to download the data. Download links can be found on the above page.
# Download: You will be sent a username and password to download the data. Download links can be found on the above page.
Line 16: Line 32:
* Development tools, available via : http://www.cstr.ed.ac.uk/projects/blizzard/, include:
* Development tools, available via : http://www.cstr.ed.ac.uk/projects/blizzard/, include:
** Submitted synthetic speech and listener scores for some previous Blizzard Challenges, which may be helpful during development
** Submitted synthetic speech and listener scores for some previous Blizzard Challenges, which may be helpful during development
** Benchmark voices (under construction)
** Specific development data for the 2012 tasks.


* Questionnaire:
* Questionnaire:
** Download the questionnaire, complete it, and return it by the deadline given in the Timeline. http://data.cstr.ed.ac.uk/blizzard2012/system_questionnaire.txt (not yet available)
** Download the questionnaire, complete it, and return it by the deadline given in the Timeline. http://data.cstr.ed.ac.uk/blizzard2012/system_questionnaire.txt


== Mailing list ==
== Mailing list ==
Line 38: Line 54:
The timeline shown on this web page is the offical one and supercedes those shown in announcements - it is subject to change, but we will try to follow it as closely as possible. Note that we will not consider any requests from participants to change the synthetic speech submission date or the paper submission date!
The timeline shown on this web page is the offical one and supercedes those shown in announcements - it is subject to change, but we will try to follow it as closely as possible. Note that we will not consider any requests from participants to change the synthetic speech submission date or the paper submission date!


   Feb  25 2011 First databases released
   Feb  25 2011 Start of Phase One. Databases released
   Aug 28-31 2011 Interspeech 2011, Florence, Italy
   Aug 28-31 2011 Interspeech 2011, Florence, Italy
   Aug/Sep ?? Blizzard 2011 workshop, Italy (provisional)
   Sep 2 Blizzard 2011 workshop, Italy
   Feb ?? 2012 Second databases released (provisional)
  Dec 4 2012 Call for participation in Phase Two and release of development set
   Sep 2-13 2012 Interspeech 2012, Portland, Oregon, USA
  Feb 20 2012 - evaluators (EH2.2) submit the test sentences that they want to be synthesised
   Aug/Sep ?? 2012 Blizzard 2012 workshop, USA (provisional)
   Mar 9 2012 - test sentences released to participants in the synthesis task (EH2.1)
  Mar 19 2012 - participants in EH2.1 submit synthetic speech
  Mar 30 2012 - synthetic speech distributed to participants in EH2.2
  Apr 2012 - main evaluation system goes live (standard MOS, SIM, WER tests)
  Jun 2012 - end of evaluation period
  Jun 2012 - evaluators return their results (written up as workshop papers)
  Jul 2012 - participants in the synthesis task submit their workshop papers
   Sep 9-13 2012 [http://www.interspeech2012.org Interspeech 2012, Portland, Oregon, USA]
   Sep 14 2012 Blizzard 2012 workshop, downtown Portland, Oregon, USA (date confirmed)


== Workshop ==
== Workshop ==


Information on the workshops will be made available nearer the time.
Information on the workshop can be found here: [[Blizzard Challenge 2012 Workshop]]


== Any questions? ==
== Any questions? ==


* Please contact blizzard@festvox.org if you have any questions
* Please contact blizzard@festvox.org if you have any questions


== Previous challenges ==
== Previous challenges ==


* [[Blizzard Challenge 2011]]
* [[Blizzard Challenge 2010]]
* [[Blizzard Challenge 2010]]
* [[Blizzard Challenge 2009]]
* [[Blizzard Challenge 2009]]
Line 64: Line 86:
* Blizzard Challenge 2005 papers and results: http://www.festvox.org/blizzard/blizzard2005.html
* Blizzard Challenge 2005 papers and results: http://www.festvox.org/blizzard/blizzard2005.html


== Concurrent challenges ==


* [[Blizzard Challenge 2011]]


[[Category:Blizzard Challenge]]
[[Category:Blizzard Challenge]]

Latest revision as of 14:16, 5 December 2018

Data for the Blizzard Challenge 2012 was generously provided by Toshiba Research Europe Ltd, Cambridge Research Laboratory http://www.toshiba-europe.com/research/crl/index.html
Google UK has generously provided financial support to the Blizzard Challenge 2012



This Blizzard Challenge has finished


Read these first

This challenge is organised in two phases. Phase 1 was a preliminary phase run during 2011. Phase 2 is the main phase and is now running. You may still register for Phase 2, even if you didn't participate in Phase 1.

Data download and license agreements

  1. Register: by emailing blizzard@festvox.org. We need to know your team name, the name of the main contact person, your affiliation, and contact details including email address, postal address and phone number.
  2. License: complete the license agreement for the data, which can be accessed via http://www.cstr.ed.ac.uk/projects/blizzard/
  3. Download: You will be sent a username and password to download the data. Download links can be found on the above page.
  • Development tools, available via : http://www.cstr.ed.ac.uk/projects/blizzard/, include:
    • Submitted synthetic speech and listener scores for some previous Blizzard Challenges, which may be helpful during development
    • Specific development data for the 2012 tasks.

Mailing list

There is a mailing list for discussion and announcements for the challenge:

 blizzard-discuss@festvox.org

Participants must join the list by sending a message to majordomo@festvox.org with the following line in the body of the message

 subscribe blizzard-discuss

Once you a member you will be able to mail messages to blizzard-discuss@festvox.org


Timeline

The timeline shown on this web page is the offical one and supercedes those shown in announcements - it is subject to change, but we will try to follow it as closely as possible. Note that we will not consider any requests from participants to change the synthetic speech submission date or the paper submission date!

  Feb  25 2011 Start of Phase One. Databases released
  Aug 28-31 2011 Interspeech 2011, Florence, Italy
  Sep 2 Blizzard 2011 workshop, Italy
  Dec 4 2012 Call for participation in Phase Two and release of development set
  Feb 20 2012 - evaluators (EH2.2) submit the test sentences that they want to be synthesised
  Mar 9 2012 - test sentences released to participants in the synthesis task (EH2.1)
  Mar 19 2012 - participants in EH2.1 submit synthetic speech
  Mar 30 2012 - synthetic speech distributed to participants in EH2.2
  Apr 2012 - main evaluation system goes live (standard MOS, SIM, WER tests)
  Jun 2012 - end of evaluation period
  Jun 2012 - evaluators return their results (written up as workshop papers)
  Jul 2012 - participants in the synthesis task submit their workshop papers
  Sep 9-13 2012 Interspeech 2012, Portland, Oregon, USA
  Sep 14 2012 Blizzard 2012 workshop, downtown Portland, Oregon, USA (date confirmed)

Workshop

Information on the workshop can be found here: Blizzard Challenge 2012 Workshop

Any questions?

  • Please contact blizzard@festvox.org if you have any questions

Previous challenges

Concurrent challenges