If you describe something as a millstone or a millstone around your neck, you mean that it is a very unpleasant problem or responsibility that you cannot escape from.
[disapproval] For today's politicians, the treaty is becoming a millstone.
That contract proved to be a millstone around his neck.