Big Arse Messages In Azure Storage Queues

We use storage queues for much communications between micro services in Azure. I ran into an issue, as in one instance messages were too large to fit into one queue message. Service Bus will let you have very large messages, but storage queues will not.

One co-worker suggested breaking down the large message into many smaller ones and send those, not a bad idea. I came across several posts that suggested combining blob storage and queues to send large amounts of data. Basically save message in a blob and send the blob’s guid as the message. I liked this better, and implemented a blob message producer. I think the idea has been around for awhile, but I got to say I like it, if you can’t use service bus that is.

Leave a Reply

Your email address will not be published. Required fields are marked *