This document says std::list is inefficient:
std::list
std::list is an extremely inefficient class that is rarely useful. It performs a heap allocation
The new slot_map proposal claim O(1) for insert and delete.
There is also a link to a video with a proposed implementation and some previous work.
If we knew more about the actual structure of the elements there might be some specialized associative containers that are much better.