Htykuut

In Dynamics CRM Online, We have Custom Solution build which stores Large file as block-blobs on Azure Blob Storage.
When I try to upload File of 40 MB I get Timeout Error. Error Log below.

What I have read is that

Uploading a block blob that is no more than 256 MB (64 MB for
requests using REST versions before 2016-05-31) can be a single write
operation using Put Blob. However, uploading a larger blob requires
some more effort. Break it down in blocks of max 4 or 100MB depending
on the REST API version that you use.

Edit: I did some more brainstorming with some Trail and Error. What I found out is that from CRM using (c#) Plugin I could easily send File upto 80 MB and this is good amount. Anyhow CRM has restriction of file size upto 128MB.

With regard to my particular problem, i also found out that main issue is caused by HTML Page, which is used as Drag and Drop for adding File to CRM and then in turn to Azure Blob.

Summary: RESTAPI for Azure is not the problem, it more lies on Dynamics CRM Side. We have to respect Timeout with efficient way to extracting Bytes from File and uploading it to Azure.

As mentioned above 256 MB file should not break it down but still I get Timeout.
Here is the method I believe is causing the Issue.

public HttpWebRequest CreateRESTRequest(string method, string resource, byte requestBody, SortedList<string, string> headers = null,

            string ifMatch = "", string md5 = "")

        {

          DateTime now = DateTime.UtcNow;

          string uri = Endpoint + resource;



          HttpWebRequest request = HttpWebRequest.Create(uri) as HttpWebRequest;

          request.Method = method;

          request.ContentLength = 0;

          request.Headers.Add("x-ms-date", now.ToString("R", System.Globalization.CultureInfo.InvariantCulture));

          request.Headers.Add("x-ms-version", "2017-04-17");



          if (IsTableStorage)

          {

            request.ContentType = "application/atom+xml";



            request.Headers.Add("DataServiceVersion", "1.0;NetFx");

            request.Headers.Add("MaxDataServiceVersion", "1.0;NetFx");

          }



          if (headers != null)

          {

            foreach (KeyValuePair<string, string> header in headers)

            {

              // This control requires that we set the ContentType through its property.

              if (header.Key.Equals("Content-Type", StringComparison.InvariantCultureIgnoreCase))

              {

                request.ContentType = header.Value;

              }

              else

              {

                request.Headers.Add(header.Key, header.Value);

              }

            }

          }



          if (requestBody?.Length > 0)

          {

            request.Headers.Add("Accept-Charset", "UTF-8");

            request.ContentLength = requestBody.Length;

          }



          request.Headers.Add("Authorization", AuthorizationHeader(method, now, request, ifMatch, md5));



          if (requestBody?.Length > 0)

          {

            request.GetRequestStream().Write(requestBody, 0, requestBody.Length);

            request.GetRequestStream().Close();

          }



          return request;

        }

Uploading Test File.pptx failed Reason: "The plug-in execution failed because no Sandbox Hosts are currently available. Please check that you have a Sandbox server configured and that it is running.rnSystem.ServiceModel.CommunicationException: The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:03:30'. ---> System.IO.IOException: The write operation failed, see inner exception. ---> System.ServiceModel.CommunicationException: The socket connection was aborted. This could be caused by an error processing your message or a receive timeout being exceeded by the remote host, or an underlying network resource issue. Local socket timeout was '00:03:30'. ---> System.Net.Sockets.SocketException: An established connection was aborted by the software in your host machinern at System.Net.Sockets.Socket.Send(Byte buffer, Int32 offset, Int32 size, SocketFlags socketFlags)rn at System.ServiceModel.Channels.SocketConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout)rn --- End of inner exception stack trace ---rn at System.ServiceModel.Channels.SocketConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout)rn at System.ServiceModel.Channels.BufferedConnection.WriteNow(Byte buffer, Int32 offset, Int32 size, TimeSpan timeout, BufferManager bufferManager)rn at System.ServiceModel.Channels.BufferedConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout)rn at System.ServiceModel.Channels.ConnectionStream.Write(Byte buffer, Int32 offset, Int32 count)rn at System.Net.Security.NegotiateStream.StartWriting(Byte buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)rn at System.Net.Security.NegotiateStream.ProcessWrite(Byte buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)rn --- End of inner exception stack trace ---rn at System.Net.Security.NegotiateStream.ProcessWrite(Byte buffer, Int32 offset, Int32 count, AsyncProtocolRequest asyncRequest)rn at System.Net.Security.NegotiateStream.Write(Byte buffer, Int32 offset, Int32 count)rn at System.ServiceModel.Channels.StreamConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout)rn --- End of inner exception stack trace ---rnrnServer stack trace: rn at System.ServiceModel.Channels.StreamConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout)rn at System.ServiceModel.Channels.StreamConnection.Write(Byte buffer, Int32 offset, Int32 size, Boolean immediate, TimeSpan timeout, BufferManager bufferManager)rn at System.ServiceModel.Channels.FramingDuplexSessionChannel.OnSendCore(Message message, TimeSpan timeout)rn at System.ServiceModel.Channels.TransportDuplexSessionChannel.OnSend(Message message, TimeSpan timeout)rn at System.ServiceModel.Channels.OutputChannel.Send(Message message, TimeSpan timeout)rn at System.ServiceModel.Dispatcher.DuplexChannelBinder.Request(Message message, TimeSpan timeout)rn at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object ins, Object outs, TimeSpan timeout)rn at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)rn at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)rnrnException rethrown at [0]: rn at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)rn at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)rn at Microsoft.Crm.Sandbox.ISandboxHost.ExecuteAndReturnTraceInfo(SandboxCallInfo callInfo, SandboxPluginExecutionContext requestContext, Guid pluginAssemblyId, Int32 sourceHash, String assemblyName, Guid pluginTypeId, String pluginTypeName, String pluginConfiguration, String pluginSecureConfig, String assemblyContents, Boolean returnTraceInfo)rn at Microsoft.Crm.Sandbox.SandboxPlugin.Execute(SandboxClient client, SandboxCallTracker callTracker, IExecutionContext requestContext, String assemblyContents, Boolean returnTraceInfo)rn at Microsoft.Crm.Sandbox.SandboxCodeUnit.ExecuteInternal(SandboxClient client, IExecutionContext context, SandboxTraceContext sandboxTraceContext, SandboxCallTracker callTracker, Guid parentExecutionId, String assemblyContents, Boolean& isSafeToRetry, Boolean& executeDone)rn at Microsoft.Crm.Sandbox.SandboxCodeUnit.<>c__DisplayClass24_0.<Execute>b__0(): Microsoft Dynamics CRM has experienced an error. Reference number for administrators or support: #D2641555"

The maximum time that a plug-in may run in Dynamics 365 is 3 minutes. If your plug-in might take longer than that, it is recommended that your plug-in trigger a queue or reach out to some external service that will run the code without a timeout.

1. Your plug-in fires and passes a record id to an external service or queue.


2. Your external code fires and reads the record from Dynamics and uploads the file to Azure.

This way the plug-in will execute quickly.