Hi,
We are experiencing that site hangs randomly during our loadtest. Site stops responding and does not respond again until a IIS-reset. We havent found any secure way to reproduce this problem but it seems it happens mostly in the beginning of the load test. We have produced a crash-dump on the w3wp-process when this happens but have a real hard time interpreting what we se. Hopefully, someone here have a clue?

It looks like most of the threads in the crash-dump are wating for something on EPiServer.ServiceLocation.ServiceLocatorImplBase.GetInstance and StructureMap.Util.Cache but we have no idea why this happens. Any ideas/help would be highly appreciated!

Some examples of thread stacks from the crash dump:

Example 1:

000000aa72e79348 00007fff47480c6a [HelperMethodFrame_1OBJ: 000000aa72e79348] System.Threading.WaitHandle.WaitOneNative(System.Runtime.InteropServices.SafeHandle, UInt32, Boolean, Boolean)
000000aa72e79470 00007fff3b79a0d1 System.Threading.WaitHandle.InternalWaitOne(System.Runtime.InteropServices.SafeHandle, Int64, Boolean, Boolean)
000000aa72e794a0 00007fff3b79a0a1 System.Threading.WaitHandle.WaitOne(Int32, Boolean)
000000aa72e794e0 00007fff39fbe110 System.Threading.ReaderWriterLockSlim.WaitOnEvent(System.Threading.EventWaitHandle, UInt32 ByRef, TimeoutTracker)
000000aa72e79530 00007fff3a575d72 System.Threading.ReaderWriterLockSlim.TryEnterUpgradeableReadLockCore(TimeoutTracker)
000000aa72e79590 00007fff39fc3d4d System.Threading.ReaderWriterLockSlim.TryEnterUpgradeableReadLock(TimeoutTracker)
000000aa72e795e0 00007ffeddc5df6b StructureMap.Util.Cache`2[[System.__Canon, mscorlib],[System.__Canon, mscorlib]].Fill(System.__Canon, System.Func`2)
000000aa72e79650 00007ffeddd9fd6f StructureMap.RootInstanceGraph.DefaultLifecycleFor(System.Type)
000000aa72e79690 00007ffeddd9fefb StructureMap.PipelineGraph.DetermineLifecycle(System.Type, StructureMap.Pipeline.Instance)
000000aa72e796c0 00007ffeddda01a7 StructureMap.SessionCache.GetDefault(System.Type, StructureMap.IPipelineGraph)
000000aa72e79710 00007ffeddda079b StructureMap.Container.GetInstance(System.Type)
000000aa72e79760 00007ffeddd98007 EPiServer.ServiceLocation.ServiceLocatorImplBase.GetInstance(System.Type, System.String)
000000aa72e797b0 00007ffeddd9815e EPiServer.ServiceLocation.ServiceLocatorImplBase.GetInstance[[System.__Canon, mscorlib]]()
000000aa72e797f0 00007ffede1927d6 EPiServer.ServiceLocation.Injected`1[[System.__Canon, mscorlib]].get_Service()
000000aa72e79830 00007ffedef68da8 EPiServer.Core.ContentProvider.LoadContentFromCacheOrRepository(EPiServer.Core.ContentReference, EPiServer.Core.ILanguageSelector)
000000aa72e79890 00007ffedef6c9cc EPiServer.Core.ProviderPipelineImplementation.GetItem(EPiServer.Core.ContentProvider, EPiServer.Core.ContentReference, EPiServer.Core.LoaderOptions)
000000aa72e79910 00007ffedef6ba39 EPiServer.Core.DefaultContentLoader.TryGet[[System.__Canon, mscorlib]](EPiServer.Core.ContentReference, EPiServer.Core.LoaderOptions, System.__Canon ByRef)
000000aa72e799e8 00007fff3ccfc29c [StubHelperFrame: 000000aa72e799e8]
000000aa72e79a40 00007ffedf3d98a4 EPiServer.Web.Routing.Segments.PartialSegment.GetLinkedObject(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary)
000000aa72e79aa0 00007ffedf3d93ef EPiServer.Web.Routing.Segments.PartialSegment.GetVirtualPathSegment(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary, System.Collections.Generic.HashSet`1)
000000aa72e79b40 00007ffedf3d924f EPiServer.Web.Routing.ContentRoute.AddVirtualPathFromSegments(System.Text.StringBuilder, System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary, System.Collections.Generic.HashSet`1, Int32)
000000aa72e79bb0 00007ffedf3d8dae EPiServer.Web.Routing.ContentRoute.GetVirtualPath(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary)
000000aa72e79c30 00007ffedf3d8956 EPiServer.Web.Routing.DefaultUrlResolver.GetUrlFromRoute(EPiServer.Core.ContentReference, System.String, System.Web.Routing.RouteValueDictionary, System.Web.Routing.RequestContext)
000000aa72e79cb0 00007ffedf3d76ee EPiServer.Web.Routing.DefaultUrlResolver.GetVirtualPathInternal(EPiServer.Core.ContentReference, System.String, EPiServer.Web.Routing.VirtualPathArguments)
000000aa72e79d50 00007ffedf431d3e EPiServer.Web.Routing.UrlResolver.GetUrl(EPiServer.Core.ContentReference, System.String, EPiServer.Web.Routing.VirtualPathArguments)
000000aa72e79d80 00007ffedf4311b5 EPiServer.Web.Mvc.Html.UrlResolverExtensions.GetShortcutAwareUrl(EPiServer.Web.Routing.UrlResolver, System.String, System.Web.Routing.RequestContext, EPiServer.IContentLoader, System.String ByRef)
000000aa72e79e50 00007ffedf430b8c EPiServer.Web.Mvc.Html.XhtmlStringExtensions.RenderFragment(EPiServer.Core.Html.StringParsing.IStringFragment, System.Web.Mvc.HtmlHelper, EPiServer.Web.Routing.UrlResolver, EPiServer.IContentLoader, System.IO.TextWriter)
000000aa72e79ee0 00007ffedf42d0e1 EPiServer.Web.Mvc.Html.XhtmlStringExtensions.RenderXhtmlStringToWriter(System.Web.Mvc.HtmlHelper, EPiServer.Core.XhtmlString, EPiServer.Web.Routing.UrlResolver, EPiServer.IContentLoader, System.IO.TextWriter)
000000aa72e79f50 00007ffedf42cfc0 EPiServer.Web.Mvc.Html.XhtmlStringExtensions.RenderXhtmlString(System.Web.Mvc.HtmlHelper, EPiServer.Core.XhtmlString)
000000aa72e79f90 00007fff34b9f437 System.Web.UI.Control.RenderChildrenInternal(System.Web.UI.HtmlTextWriter, System.Collections.ICollection)
000000aa72e79ff0 00007fff34b9f630 System.Web.UI.Control.RenderControlInternal(System.Web.UI.HtmlTextWriter, System.Web.UI.Adapters.ControlAdapter)
000000aa72e7a030 00007fff34b9f3d0 System.Web.UI.Control.RenderChildrenInternal(System.Web.UI.HtmlTextWriter, System.Collections.ICollection)
000000aa72e7a090 00007ffedf3e6dfc System.Web.Mvc.ViewPage.Render(System.Web.UI.HtmlTextWriter)
000000aa72e7a0d0 00007fff34b9f630 System.Web.UI.Control.RenderControlInternal(System.Web.UI.HtmlTextWriter, System.Web.UI.Adapters.ControlAdapter)
000000aa72e7a110 00007fff34baf4d9 System.Web.UI.Page.ProcessRequestMain(Boolean, Boolean)
000000aa72e7a450 00007fff34bacfe3 System.Web.UI.Page.ProcessRequest(Boolean, Boolean)
000000aa72e7a4a0 00007fff34bacefc System.Web.UI.Page.ProcessRequest()
000000aa72e7a4f0 00007fff34bace76 System.Web.UI.Page.ProcessRequest(System.Web.HttpContext)
000000aa72e7a530 00007ffedf3e6aaf System.Web.Mvc.HttpHandlerUtil+ServerExecuteHttpHandlerWrapper+<>c__DisplayClass4.b__3()
000000aa72e7a560 00007ffedf3e6a0b System.Web.Mvc.HttpHandlerUtil+ServerExecuteHttpHandlerWrapper.Wrap[[System.__Canon, mscorlib]](System.Func`1)

-----

Example 2:

000000aa72cfb1d8 00007fff47480c6a [HelperMethodFrame_1OBJ: 000000aa72cfb1d8] System.Threading.WaitHandle.WaitOneNative(System.Runtime.InteropServices.SafeHandle, UInt32, Boolean, Boolean)
000000aa72cfb300 00007fff3b79a0d1 System.Threading.WaitHandle.InternalWaitOne(System.Runtime.InteropServices.SafeHandle, Int64, Boolean, Boolean)
000000aa72cfb330 00007fff3b79a0a1 System.Threading.WaitHandle.WaitOne(Int32, Boolean)
000000aa72cfb370 00007fff39fbe110 System.Threading.ReaderWriterLockSlim.WaitOnEvent(System.Threading.EventWaitHandle, UInt32 ByRef, TimeoutTracker)
000000aa72cfb3c0 00007fff3a575d72 System.Threading.ReaderWriterLockSlim.TryEnterUpgradeableReadLockCore(TimeoutTracker)
000000aa72cfb420 00007fff39fc3d4d System.Threading.ReaderWriterLockSlim.TryEnterUpgradeableReadLock(TimeoutTracker)
000000aa72cfb470 00007ffeddc5df6b StructureMap.Util.Cache`2[[System.__Canon, mscorlib],[System.__Canon, mscorlib]].Fill(System.__Canon, System.Func`2)
000000aa72cfb4e0 00007ffeddc61f5a StructureMap.Graph.PluginGraph.HasDefaultForPluginType(System.Type)
000000aa72cfb520 00007ffeddc61e11 StructureMap.Container.TryGetInstance(System.Type)
000000aa72cfb570 00007ffeddc61d72 EPiServer.ServiceLocation.StructureMapServiceLocator.DoTryGetExistingInstance(System.Type, System.String, System.Object ByRef)
000000aa72cfb5a0 00007ffeddc61ce2 EPiServer.ServiceLocation.ServiceLocatorImplBase.TryGetExistingInstance[[System.__Canon, mscorlib]](System.String, System.__Canon ByRef)
000000aa72cfb600 00007ffede19da33 EPiServer.Web.SiteDefinition.GetCurrentInternal(System.Func`3)
000000aa72cfb660 00007ffedf3d9ff9 EPiServer.Web.Routing.Segments.DefaultUrlSegmentRouter.IsContentUnderRoot(EPiServer.Core.ContentReference)
000000aa72cfb6b0 00007ffedf3d9db7 EPiServer.Web.Routing.Segments.NodeSegment.GetVirtualPathSegment(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary)
000000aa72cfb720 00007ffedf3d9be9 EPiServer.Web.Routing.Segments.NodeSegment.GetVirtualPathSegment(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary, System.Collections.Generic.HashSet`1)
000000aa72cfb780 00007ffedf3d924f EPiServer.Web.Routing.ContentRoute.AddVirtualPathFromSegments(System.Text.StringBuilder, System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary, System.Collections.Generic.HashSet`1, Int32)
000000aa72cfb7f0 00007ffedf3d8dae EPiServer.Web.Routing.ContentRoute.GetVirtualPath(System.Web.Routing.RequestContext, System.Web.Routing.RouteValueDictionary)
000000aa72cfb870 00007ffedf3d8956 EPiServer.Web.Routing.DefaultUrlResolver.GetUrlFromRoute(EPiServer.Core.ContentReference, System.String, System.Web.Routing.RouteValueDictionary, System.Web.Routing.RequestContext)
000000aa72cfb8f0 00007ffedf3d76ee EPiServer.Web.Routing.DefaultUrlResolver.GetVirtualPathInternal(EPiServer.Core.ContentReference, System.String, EPiServer.Web.Routing.VirtualPathArguments)
000000aa72cfb990 00007ffedf3d7241 EPiServer.Web.Routing.UrlResolver.GetUrl(EPiServer.Core.ContentReference, System.String)
000000aa72cfb9c0 00007ffedf80bd71 Folkspel.WebSites.Web.Controllers.CommonController+<>c.b__3_1(Folkspel.WebSites.Web.Models.Blocks.PartnerBlock)
000000aa72cfba00 00007fff39fdaedf System.Linq.Enumerable+WhereSelectListIterator`2[[System.__Canon, mscorlib],[System.__Canon, mscorlib]].MoveNext()
000000aa72cfba50 00007fff3b7952bc System.Collections.Generic.List`1[[System.__Canon, mscorlib]]..ctor(System.Collections.Generic.IEnumerable`1)
000000aa72cfbac0 00007fff39ff1406 System.Linq.Enumerable.ToList[[System.__Canon, mscorlib]](System.Collections.Generic.IEnumerable`1)
000000aa72cfbb00 00007ffedf809c95 Folkspel.WebSites.Web.Controllers.CommonController.PartnerFooter()
000000aa72cfbb50 00007ffedf943b57 DynamicClass.lambda_method(System.Runtime.CompilerServices.Closure, System.Web.Mvc.ControllerBase, System.Object[])
000000aa72cfbb80 00007ffedf3c1935 System.Web.Mvc.ReflectedActionDescriptor.Execute(System.Web.Mvc.ControllerContext, System.Collections.Generic.IDictionary`2)
000000aa72cfbbe0 00007ffedf3c1a03 System.Web.Mvc.ControllerActionInvoker.InvokeActionMethod(System.Web.Mvc.ControllerContext, System.Web.Mvc.ActionDescriptor, System.Collections.Generic.IDictionary`2)
000000aa72cfbc20 00007ffedf3c1a67 System.Web.Mvc.Async.AsyncControllerActionInvoker.b__39(System.IAsyncResult, ActionInvocation)
000000aa72cfbc50 00007ffedf3c6ba7 System.Web.Mvc.Async.AsyncResultWrapper+WrappedAsyncResult`2[[System.__Canon, mscorlib],[System.Web.Mvc.Async.AsyncControllerActionInvoker+ActionInvocation, System.Web.Mvc]].CallEndDelegate(System.IAsyncResult)
000000aa72cfbcb0 00007ffedf3c1d7a System.Web.Mvc.Async.AsyncControllerActionInvoker.EndInvokeActionMethod(System.IAsyncResult)
000000aa72cfbce0 00007ffedf3c2428 System.Web.Mvc.Async.AsyncControllerActionInvoker+AsyncInvocationWithFilters.b__3d()
000000aa72cfbd20 00007ffedf3c271c System.Web.Mvc.Async.AsyncControllerActionInvoker+AsyncInvocationWithFilters+<>c__DisplayClass46.b__3f()
000000aa72cfbd90 00007ffedf3c271c System.Web.Mvc.Async.AsyncControllerActionInvoker+AsyncInvocationWithFilters+<>c__DisplayClass46.b__3f()
000000aa72cfbe00 00007ffedf3c271c System.Web.Mvc.Async.AsyncControllerActionInvoker+AsyncInvocationWithFilters+<>c__DisplayClass46.b__3f()
000000aa72cfbe70 00007ffedf3c306a System.Web.Mvc.Async.AsyncControllerActionInvoker.EndInvokeActionMethodWithFilters(System.IAsyncResult)
000000aa72cfbea0 00007ffedf3c3526 System.Web.Mvc.Async.AsyncControllerActionInvoker+<>c__DisplayClass21+<>c__DisplayClass2b.b__1c()
000000aa72cfbf10 00007ffedf3c3655 System.Web.Mvc.Async.AsyncControllerActionInvoker+<>c__DisplayClass21.b__1e(System.IAsyncResult)
000000aa72cfbf60 00007ffedf3c3866 System.Web.Mvc.Async.AsyncControllerActionInvoker.EndInvokeAction(System.IAsyncResult)