That's why I wrote leaflet-editable-polylines.
How it works? It doesn't show the editable markers until you zoom close enough. (That was the original problem, too many markers with too many event handlers to handle all the time).
Check here for an example with 20,000 points.