spruce5637 OP t1_iwuzdlt wrote
Reply to comment by killver in [D] NLP folks who have used AllenNLP, how do you migrate your projects to other framework(s)? by spruce5637
I have a project in development that's using AllenNLP and I hope to move it out of the framework. My main concern is ensuring everything works like before when I switch over (e.g. the tokenizer, the encoder, the whole data "pipeline")
(Edit: I'm also not sure if I should dig into their source code and compare it with Huggingface to ensure everything works as before under the hood, since reproducibility is really important and all)
killver t1_iwv0pg0 wrote
You didn't really answer my question what parts of your pipeline you want to try to move. But in general AllenNLP is for quite some time now already irrelevant in the space, Id suggest to move to Huggingface asap.
spruce5637 OP t1_iwyh6fe wrote
>You didn't really answer my question what parts of your pipeline you want to try to move.
...almost the whole pipeline? Reading in examples, batching them, tokenization, encoding them into tensors, training, saving, loading for prediction are all built under the framework.
>But in general AllenNLP is for quite some time now already irrelevant in the space, Id suggest to move to Huggingface asap.
Yeah that's the vibe I'm getting, hence the post. Thanks for your suggestions though!
Viewing a single comment thread. View all comments