Has an attempt been made on the Raspberry Pi family via Buildroot perhaps?

Is linux-libre supported via Buildroot?