Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

couldn't get F1 91.21 #33

Open
mungg opened this issue Jan 18, 2019 · 2 comments
Open

couldn't get F1 91.21 #33

mungg opened this issue Jan 18, 2019 · 2 comments

Comments

@mungg
Copy link

mungg commented Jan 18, 2019

Thanks for your clear code and instruction!
I run a code on CONLL2003 without modifying other hyper-parameter and structure, the F1 score of testb is about to 90.6 which is not reaching the your report(91.2) (at char CNN + LSTM+CRF)
also, LSTM+CRF shows the 89.xx~ 90.0x. I got a little bit lower scores comparing with your reports.
I was wondering if it needed to change the default hyper-parameter.
Could your provide some insight about this result?

@lanzhuzhu
Copy link

I met the same problem. I used the embedding "glove.6B.300d.txt" and tested the two versions of your code. One model is "chars_lstm_lstm_crf model ", the other is "sequence_tagging". From my results, the chars_lstm_lstm_crf model performs worse in the same condition. Is this common?

@guillaumegenthial
Copy link
Owner

@mungg and @lanzhuzhu ,
Try using the 840B.300d vectors as well as the BIOES tagging scheme.
You should be able to get good results (in average).
Note that some runs perform better than others and the results I report on the README are averaged over 5 runs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants