2018百度机器阅读理解技术竞赛
类型 | train | dev | test |
---|---|---|---|
比赛 | 27W | 1W | 2W |
开放 | 20W | 1W | 1W |
Model | Rouge-L | Bleu-4 |
---|---|---|
BiDAF(cuDNN based) | 46.56 | 40.95 |
R-Net | 42.09 | 41.1 |
BiDAF+Self Attention | 47.28 | 41.3 |
BiDAF+Self Attention+Gated RNN | 47.71 | 41.75 |
i7-7700k + 32G RAM + GTX1080Ti
batch size=32 dropout=0.7
Model | GPU Memory | Time(50 batch) | word embedding trainable |
---|---|---|---|
BiDAF(origin) | 8431M | 47s | false |
MLSTM | 10655M | 1min27s | false |
R-Net | 4295M | 23s | false |
BiDAF+Self Attention(cuDNN based) | 8431M | 22s | false |
BiDAF+Self Attention+Gated RNN(Pre) | N/A | N/A | false |