What if facets were exposed to views? Then you could output facet data in any display format you'd want and is already implemented by views display modules.

Let's think about how that architecture would work.