[Bug]? Terminal scrolling is slow when start nvim inside a sshfs folder

I mounted a remote folder through sshfs remote-machine:~/folder remote-folder. If I cd remote-folder and start nvim inside it, when open a neovim terminal, scrolling operation is very slow.
This only happens for terminal buffer, even for terminal running on my local shell. Scrolling inside a text buffer (even for remote file) is fine though.

As soon as I change my directory outside of the mounted folder :cd .. then scrolling on terminal buffer is smooth again.

Wondering if anybody has the same issue.

I use this workflow extensively and have not had this issue before. Maybe you/some plugin is doing something with files under the current directory and due to the latency of a remote filesystem it’s slowing you down.