Viewing a single comment thread. View all comments

farmingvillein t1_j8pni5v wrote on February 16, 2023 at 1:20 AM

Reply to comment by gwern in [R] RWKV-4 14B release (and ChatRWKV) - a surprisingly strong RNN Language Model by bo_peng

Neither of these offer a comparative look against transformers, although they are certainly a useful look against the limitations of your basic RNN/LSTM.