========================================================================================== Alignment scoring results ========================================================================================== Date : Sunday, 10. July 2016 06:26AM Scoring script version : v0.3 ------------------------------------------------------------------------------------------ Reference script : /share/spandh.ami1/asr/eval/mgb16/tasks/scoring/lsa/mgb-challenge-2015/dev15.full.script.stm Reference alignment : /share/spandh.ami1/asr/eval/mgb16/tasks/scoring/lsa/mgb-challenge-2015/dev15.full.ref.ctm System output : ./scoring/dev15.full.ctm Filtering UEM : /share/spandh.ami1/asr/eval/mgb16/tasks/scoring/lsa/mgb-challenge-2015/dev15.full.overlap.uem ------------------------------------------------------------------------------------------ ... reading reference ... aligning script to reference ... reading uem file - /share/spandh.ami1/asr/eval/mgb16/tasks/scoring/lsa/mgb-challenge-2015/dev15.full.overlap.uem ... reading system output ... aligning script to system output ... reading uem file - /share/spandh.ami1/asr/eval/mgb16/tasks/scoring/lsa/mgb-challenge-2015/dev15.full.overlap.uem ... matching ------------------------------------------------------------------------------------------ 20080509_170000_bbctwo_eggheads #ref 3260/4981 #hyp 3243/3931 match 3243/3931 prec 0.9556 rec 0.9506 f 0.9531 20080511_050000_bbctwo_fimbles #ref 1732/2259 #hyp 1563/1654 match 1563/1654 prec 0.8452 rec 0.7627 f 0.8018 20080507_161500_bbctwo_escape_to_the_country #ref 4874/8245 #hyp 4866/7123 match 4866/7123 prec 0.9618 rec 0.9602 f 0.9610 20080510_104500_bbctwo_sportsround #ref 1336/2697 #hyp 1443/1817 match 1443/1817 prec 0.8676 rec 0.9371 f 0.9010 20080509_193000_bbcone_a_question_of_sport #ref 1739/3112 #hyp 1540/1952 match 1540/1952 prec 0.8487 rec 0.7516 f 0.7972 20080507_093000_bbctwo_a_picture_of_britain #ref 5428/6501 #hyp 5375/5669 match 5375/5669 prec 0.9591 rec 0.9497 f 0.9544 20080505_190000_bbctwo_snooker_world_championship #ref 3158/6404 #hyp 3525/3807 match 3525/3807 prec 0.7850 rec 0.8762 f 0.8281 20080510_191500_bbcthree_top_gear #ref 5631/9408 #hyp 5513/7331 match 5513/7331 prec 0.9187 rec 0.8995 f 0.9090 20080508_005500_bbcone_meet_the_immigrants #ref 2530/3124 #hyp 2308/2459 match 2308/2459 prec 0.8843 rec 0.8067 f 0.8437 20080508_101000_bbctwo_schools_primary_geography #ref 1211/1431 #hyp 1189/1219 match 1189/1219 prec 0.8915 rec 0.8753 f 0.8833 20080509_190000_bbcfour_bbc_young_musician_of_the_year_2008 #ref 5239/6892 #hyp 4963/5375 match 4963/5375 prec 0.9164 rec 0.8681 f 0.8916 20080511_052000_bbctwo_tikkabilla #ref 2200/4243 #hyp 2129/2582 match 2129/2582 prec 0.8657 rec 0.8377 f 0.8515 20080507_190000_bbctwo_city_salute_with_princes_william_and #ref 3994/5587 #hyp 4125/4306 match 4125/4306 prec 0.8735 rec 0.9021 f 0.8875 20080509_140500_bbcone_space_pirates #ref 1765/2125 #hyp 1989/2068 match 1989/2068 prec 0.7466 rec 0.8414 f 0.7912 20080505_200000_bbcone_waking_the_dead #ref 4008/5634 #hyp 3668/4597 match 3668/4597 prec 0.9125 rec 0.8351 f 0.8721 20080511_210500_bbctwo_russia_a_journey_with_jonathan_dimbleby #ref 5855/6409 #hyp 5760/5926 match 5760/5926 prec 0.9620 rec 0.9464 f 0.9541 20080509_084000_bbctwo_something_special #ref 826/2019 #hyp 791/1306 match 791/1306 prec 0.7219 rec 0.6913 f 0.7062 20080509_013000_bbcone_bill_oddie_s_wild_side #ref 2980/3592 #hyp 2801/3125 match 2801/3125 prec 0.9250 rec 0.8695 f 0.8964 20080509_160000_bbcone_newsround #ref 900/1714 #hyp 985/1054 match 985/1054 prec 0.8660 rec 0.9478 f 0.9050 20080510_183000_bbcthree_doctor_who_confidential #ref 4415/6071 #hyp 4266/4619 match 4266/4619 prec 0.9088 rec 0.8781 f 0.8932 20080510_180000_bbctwo_dad_s_army #ref 1784/3899 #hyp 1743/2434 match 1743/2434 prec 0.8055 rec 0.7870 f 0.7961 20080509_100000_bbcone_to_buy_or_not_to_buy #ref 4073/9688 #hyp 4145/7512 match 4145/7512 prec 0.9209 rec 0.9371 f 0.9289 20080511_203000_bbcthree_little_britain #ref 2937/3449 #hyp 2817/3021 match 2817/3021 prec 0.8946 rec 0.8580 f 0.8759 20080511_004500_bbcthree_two_pints_of_lager_and #ref 2690/4090 #hyp 2639/2900 match 2639/2900 prec 0.8700 rec 0.8535 f 0.8617 20080509_124000_bbcone_doctors #ref 2520/3042 #hyp 2361/2516 match 2361/2516 prec 0.9081 rec 0.8508 f 0.8785 20080511_172500_bbcone_bbc_london_news #ref 1085/1655 #hyp 1124/1155 match 1124/1155 prec 0.9422 rec 0.9760 f 0.9588 20080505_200000_bbcfour_christina_a_medieval_life #ref 7152/8132 #hyp 7075/7401 match 7075/7401 prec 0.9702 rec 0.9597 f 0.9649 20080508_173000_bbctwo_great_british_menu #ref 3906/5130 #hyp 3872/4326 match 3872/4326 prec 0.9569 rec 0.9485 f 0.9527 20080505_180000_bbcfour_the_book_quiz #ref 2906/5515 #hyp 2900/4172 match 2900/4172 prec 0.9231 rec 0.9212 f 0.9221 20080509_180000_bbcone_the_one_show #ref 2749/5890 #hyp 2888/4073 match 2888/4073 prec 0.9006 rec 0.9462 f 0.9228 20080506_093000_bbctwo_schools_let_s_write_poetry #ref 2466/3004 #hyp 2477/2680 match 2477/2680 prec 0.9548 rec 0.9590 f 0.9569 20080511_210000_bbcone_bbc_news #ref 2257/3174 #hyp 2326/2433 match 2326/2433 prec 0.9484 rec 0.9774 f 0.9627 20080505_220000_bbcthree_placebo #ref 2714/3502 #hyp 2575/2713 match 2575/2713 prec 0.8513 rec 0.8077 f 0.8289 20080510_174500_bbcone_doctor_who #ref 3747/4547 #hyp 3200/3461 match 3200/3461 prec 0.9222 rec 0.7876 f 0.8496 20080509_183000_bbctwo_the_trees_that_made_britain #ref 3401/4519 #hyp 3351/3809 match 3351/3809 prec 0.9463 rec 0.9324 f 0.9393 20080506_213000_bbcthree_scallywagga #ref 2152/3204 #hyp 2044/2281 match 2044/2281 prec 0.8664 rec 0.8230 f 0.8441 20080509_141500_bbctwo_through_the_keyhole #ref 2818/4706 #hyp 2761/3725 match 2761/3725 prec 0.9366 rec 0.9177 f 0.9270 20080505_193000_bbcone_panorama #ref 3784/4498 #hyp 3877/3939 match 3877/3939 prec 0.9373 rec 0.9604 f 0.9487 20080509_190000_bbcone_eastenders #ref 3144/4058 #hyp 2781/3137 match 2781/3137 prec 0.9256 rec 0.8187 f 0.8689 20080509_180000_bbcfour_world_news_today #ref 3271/5259 #hyp 3527/3798 match 3527/3798 prec 0.8962 rec 0.9664 f 0.9300 20080509_153000_bbctwo_ready_steady_cook #ref 2297/10550 #hyp 2161/6109 match 2161/6109 prec 0.8862 rec 0.8337 f 0.8591 20080511_220500_bbctwo_graham_norton_uncut #ref 3756/7501 #hyp 3265/4809 match 3265/4809 prec 0.8141 rec 0.7077 f 0.7572 20080511_113000_bbctwo_premiership_rugby #ref 2313/4943 #hyp 2595/2729 match 2595/2729 prec 0.7854 rec 0.8811 f 0.8305 20080505_193000_bbcthree_glamour_girls #ref 3365/5193 #hyp 3345/3907 match 3345/3907 prec 0.8945 rec 0.8892 f 0.8918 20080509_024500_bbcthree_dog_borstal #ref 2621/3672 #hyp 2589/2868 match 2589/2868 prec 0.9115 rec 0.9004 f 0.9060 20080511_180000_bbcthree_radio_1_s_big_weekend #ref 1055/5255 #hyp 1105/2264 match 1105/2264 prec 0.7448 rec 0.7801 f 0.7620 20080507_222000_bbctwo_parallel_worlds_parallel_lives #ref 6405/8050 #hyp 6274/6822 match 6274/6822 prec 0.9066 rec 0.8881 f 0.8972 ------------------------------------------------------------------------------------------ Final results ------------------------------------------------------------------------------------------ Effective #words in reference : 146449 Effective #words in hypothesis : 143859 Match count : 130178 ------------------------------------------------------------------------------------------ Precision : 0.9049 Recall : 0.8889 F : 0.8968 ==========================================================================================