Export Attachments using OData

I am wanting to export attachments from my accounting software through an OData feed. I can export the data, but the attachments just bring the name, and not the whole attachment. Is there a way to export the attachments through OData? Or do I need a different type of feed?