What's wrong with mark-and-sweep GCs?

Question

I\'m reading Steve Yegge\'s \"Dynamic Languages Strike Back\" talk, and in it he sort of criticizes mark-and-sweep GCs (about 5-10 percent through that link, the \"Pigs attempt\

Answer 1

^{(It is worth noting that Steve Yegge's talk was presented a long time ago now, and that some of the generalizations he makes about dynamic languages and their implementations are out of date. And contrary-wise, implying that generational garbage collection is the solution to GC pauses is ... optimistic. Especially when you consider the kind of real-time characteristics demanded by gamers.)}

Here's a high-level bullet point comparison of the various techniques mentioned in the referenced quotation (plus "mark-and-compact" ... which is a variation on mark-and-sweep.)

The properties of reference counting collection are:

• PRO - garbage is reclaimed immediately (apart from cycles)
• PRO - garbage collection pauses are smaller, and minimal if you can defer updating the "free space" data structure.
• CON - reference counts need to be adjusted on most pointer write operation
• CON - free space is never compacted
• CON - because free space is not compacted, a "free space" data structure must be maintained which increases allocation and deallocation costs.
• CON - cyclic garbage is not collected, unless the application breaks the cycle by hand.
• CON - updating reference counts in a multi-threaded app is extra expensive.

For classic mark-and-sweep:

• PRO - no pointer write overhead
• PRO - cyclic data is collected
• PRO - storage management concurrency bottlenecks can be avoided (apart from GC)
• CON - stop-the-world garbage collection
• CON - free space is never compacted
• CON - because free space is not compacted, a "free space" data structure must be maintained which increases allocation and deallocation costs.

Classical mark-and-sweep is sometimes modified so that the sweep phase compacts the free space by "sliding" non-garbage objects. This is called "mark-sweep-compact". This is fairly complicated but:

• PRO - no pointer write overhead
• PRO - cyclic data is collected
• PRO - storage management concurrency bottlenecks can be easily avoided (apart from GC)
• CON - stop-the-world garbage collection
• PRO - free space is compacted, so allocation is cheap
• CON - the compact phase is rather expensive

Modern collectors (including typical generational collectors) are based on mark-and-copy. The idea is that the collector traces objects in a "from space" copying them to a "to space". When it is done, the "to space" has a contiguous chunk of free space at the end which can be used for allocating new objects. The old "from space" is put on one side for the next time the garbage collector runs. The nice thing about copying collection is that the garbage collection cost associated with a garbage object is close to zero.

• CON - pointer write overhead (to record when a "new generation" pointer is written into an "old generation" object)
• PRO - cyclic data is collected
• PRO - storage management concurrency bottlenecks can be easily avoided (apart from GC)
• CON - stop-the-world garbage collection, though this can be mitigated at the cost of some runtime overheads
• PRO - with generational collectors, you usually GC just part of the heap with lots of garbage, and hence GC overheads are less on average
• PRO - smaller GC pauses (most of the time)
• PRO - free space is compacted, so allocation is cheap
• PRO - compaction comes more cheaply than with a sliding compacter
• CON - you need to reserve an extra object space for the collector.

A generational collector is one where there are multiple spaces (generations), that are collected at different rates. This is based on the "weak generational hypothesis" that posits that most objects become unreachable quickly; i.e. they die young. So by garbage collecting the space containing the young objects, you reclaim a relatively large amount of space at relatively low cost. You still need to collect the older generations, but this can happen less frequently.

(A mark-and-sweep collector could be generational, but the pay-off isn't as great as for a copying collector.)