In previous post I've shown how a temporary table can be generated based on IQueryable and then reused in subsequent queries. I have also pointed out a serious limitation. The goal of this post is to address that limitation and touch on unit testing aspect.
dotnetomaniak.pl - Artykuły z tagiem performance
![Making bits faster – IndexOutOfRange]()
![Independent code in performance optimizations – IndexOutOfRange]()
![Using bit masks for high-performance calculations – IndexOutOfRange]()
![[EN] Entity Framework 6 - Dynamically creating temporary tables from IQueryable (Part 1 of 2)]()
![[EN] The ugly truth behind pretty URLs]()
![[EN] Problems with AsParallel – IndexOutOfRange]()
![Hryniewski.NET | Trzy słowa o optymalizacji LINQ]()
![[EN]Debugging high memory usage. Part 2 - .NET Memory Profiler – IndexOutOfRange]()
![[EN] Debugging high memory usage. Part 1 - ProcDump – IndexOutOfRange]()
![[EN] The cost of garbage collection – IndexOutOfRange]()
![Invoking methods dynamically in C#: Examples and benchmarks – Kuba on .NET]()
![netric.io - lightweight ASP.NET profiler · Maciek Lesiczka]()
![GC can kill You. Practical GC performance counters in .NET – IndexOutOfRange]()
![System.Console is slow – IndexOutOfRange]()
![[EN] Measure your CPU & RAM usage with performance watcher | Piotr Gankiewicz]()
![[EN] MS Research - High-Performance Incremental Processing of Complex Analytical Queries]()
![[EN] Tweak your application with ETags | blog.kateo.pl]()
![[EN] Speed up you ASP.NET MVC application by removing unused view engines | blog.kateo.pl]()
![Piotr Zieliński » Modyfikator sealed dla klas–wydajność]()
performance
Reading time ~2 minutes This post was inspired by a discussion on Reddit that followed my previous post In this post, I will cover a suggestion by BelowAverageITGuy that cut down the total execution time by almost one hour. Saga Before I go further here are some link to the previous posts on the problem of calculating similarities and then optimizing it grew to few post. Here are all of them:How I calculate similarities in cookit?How to calculate 17 billion similaritiesIndependent code in ...
Sztuka programowania 785 dni, 18 godzin, 24 minuty temu 94 rozwiń
Reading time ~1 minute This will be a fast errata to the previous one. This time I will expand the oldest performance mantra: The fastest code is the one that doesn’t execute. Second to that is the one that executes once Last time I’ve forgot to mention one very important optimization. It was one of two steps that allowed me to go from 1530 to 484 seconds in the sample run.Saga Before I go further here are some link to the previous posts on the problem of calculating similarities and then...
Programowanie rozproszone 798 dni, 19 godzin, 54 minuty temu 46 rozwiń
Reading time ~6 minutes Last time I’ve shown how I’ve gone from 34 hours to 11. This time we go faster. To go faster I have to do less. The current implementation of Similarity iterates over one vector and checks if that ingredient exists in the second one. Since those vectors are sparse the chance of a miss is big. This means that I am losing computational power on iterating and calling TryGetValue. How to iterate only over the mutually owned ones and do it fast? Saga Before I go furth...
Sztuka programowania 795 dni, 19 godzin, 34 minuty temu 56 rozwiń
I'm a huge fan of entity based and result set based relational mapping (classic ORMs). I'm also huge fan of DML based relational mapping (micro ORMs). In general I'm a huge fan of every technology that allows me to get the job done in the best possible way. I believe that one should never limit himself to single approach within a project - it should always be about choosing the best tool for the job. But sometimes there are real life constraints (licensing, business, politics etc.) which are limiting the...
Attribute routing (RouteAttribute) is a quite handy feature of ASP.NET MVC. It allows you to have nice looking URLs that everybody has already accustomed to and your client surely loves it. Plus it hides your true controller/action structure which sometimes might be desirable. But there's one catch. As your web app gets bigger and bigger, attribute routing might have a negative performance impact on your WHOLE website.
Reading time ~6 minutes This post is covering a subset of what I am talking in my talk How I stopped worrying and learned to love parallel processing (currently only in polish). This will cover on how, in terms of performance, AsParallel can kick you in a place where it hurts a lot, simultaneously being a blessing in terms of… performance. How is that? Let’s look at someHistory AsParallel was introduced as an extension to LINQ with TPL in .NET 4.0. In theory, it’s God’s sent. The promise w...
Architektura 811 dni, 16 godzin, 27 minut temu 109 rozwiń
Kontynuując wątek LINQ, który podjąłem jakiś czas temu, poruszę dziś temat optymalizacji operacji jakie wykonujemy na kolekcjach. Na starcie muszę się przyznać, że tytuł nie jest do końca zgodny z prawdą, bo trzy słowa to o wiele za mało, by wejść w głębiej w temat optymalizacji zapytań. Są jednak 3 metody, które można wykorzystać do znacznego przyspieszenia wykonywania operacji w bardziej rozbudowanych łańcuchach przy minimalnym nakładzie pracy.
Źródło:
hryniewski.net
Dziel się z innymi:
Reading time ~4 minutes Diagnosing high memory usage can be tricky, here is the second part of how I found what was hogging to much memory in our system. In the previous post I’ve wrote how to create a memory dump and how many possibilities of catching just the right moment for it ProcDump has. When trying to analyze memory leaks, or high memory usage (not necessary meaning a leak) we have a few ways to approach it: Attach a debugger There are many problems with this approach, to name a fe...
Źródło:
indexoutofrange.com
Dziel się z innymi:
Reading time ~2 minutes I’m taking a short break from Hangfire series, but I will get back to it. This time - Where did my memory go ? Or to be more exact: Why is this using so much memory? The story starts with one IIS application pool using around 6 Gigabytes of memory on one of our test environments. It was several times above the values that we expected it to use, so we decided to investigate. Without much thinking we fired up Visual Studio installed on the test server, and attached to the proce...
Źródło:
indexoutofrange.com
Dziel się z innymi:
Architektura 870 dni, 20 godzin, 6 minut temu 64 rozwiń
Just how long does garbage collection take in .NET? Which generation takes longer?
Sztuka programowania 929 dni, 15 godzin, 49 minut temu 123 rozwiń
Imagine that you have a service, which receives requests to execute specific methods, possibly from a number of different underlying libraries that you don’t want to expose directly. Possible examples are web services. The request comes in as a number of string values (method name, parameters etc.) and you need to respond with results. So you have inherited a project with API that starts with a method: object Invoke(string methodName, object[] parameters); You now have to call variety o...
Over the last year on my spare time, I’ve been working on profiler for ASP.NET apps - netric.io. This small tool instruments methods from chosen assemblies and visualizes statistics of their execution times. It has got lower priority for me for a long time because of “Daj Się poznać” and other things but I think this project is worth to finally shed some light on it. Right now, the tool does just one thing: for every HTTP request, it generates methods time visualization like this (click to enlarge): ...
One of the steps in cookit is calculating similar recipes. This is what you can see on the left on the recipe page like this For the sake of clarity and manageability it’s scheduled as separate Hangfire jobs. Because cookit is running 5 workers, so similarities are calculated for 5 websites concurrently. The process uses cosine similarity, so it allocates a huge list at start and calculates similarities. A very CPU heavy operation. So some time after triggering all recipes recalculation I saw this in...
Źródło:
indexoutofrange.com
Dziel się z innymi:
Anyone who made any HackerRank problems considering performance has seen this phrase in the assignment: “watch out for slow IO”. We are used to thing about files, databases and such as potentially slow IO, but the Console? Yes, and you will be amazed how much. Couple words about the setup. I am using NLog with file target (for normal logging) and mail target (for total failure, and aggregated reports). When debugging or profiling I run the process as a con...
The latest, 6th watcher, has been recently added to the Warden library. It’s probably the simplest one, but it doesn’t mean it’s barely useful. The performance watcher has been created in order to measure the CPU & RAM usage, simple as that. Sounds interesting? If that’s the case, you might find the whole note useful then.
Tagi:
.Net, .netcore, C#, Daj się poznać, dajsiepoznac, open source, performance, Performance Counters
Źródło:
piotrgankiewicz.com
Dziel się z innymi:
Daj się poznać 2016 1023 dni, 17 godzin, 49 minut temu 37 rozwiń
In this talk, I will present techniques for efficient incremental processing of complex analytical queries, ranging from classical SQL queries to linear algebra programs. Our system, called DBToaster, compiles declarative database queries into high-performance stream processing engines that keep query results (views) fresh at very high update rates. DBToaster uses a recursive query compilation algorithm that materializes a supporting set of higher-order delta views to achieve a substantially lower view m...
Sztuka programowania 1066 dni, 6 godzin, 55 minut temu 25 rozwiń
The ETag or Entity Tag is a part of HTTP protocol used for caching purposes. In the simplest way ETags are strings that help browser to identify and validate cache. Like almost everything the ETags can be inefficient while configured incorrectly. So let's have a closer look at them..
ASP.NET MVC by default ships with two view engines: Web Forms and Razor. When we are creating a new ASP.NET MVC application both are being included in the application startup. Even when you are working with Razor only ASP.NET MVC resolves named views by searching for files that match the Web Forms view engine's naming convention at first. What can we do to change that and reduce the time needed to return a view to the end user? Let's have a look!
O korzyściach z modyfikatora sealed, od strony projektowej pisałem już tutaj. Dzisiaj postanowiłem jednak napisać prosty program, który pokaże nam czy faktycznie są jakieś różnice wydajnościowe. Oczywiście jest to raczej ciekawostka dla ludzi zajmujących się c# internals. Jeśli zależy nam na optymalizacji, zawsze zaczynajmy od ulepszenia samego algorytmu (zmniejszenia jego złożoności), a w ostateczności sięgajmy po mikro-optymalizacje. Warto stosować wspominane wskazówki, ale ze względu na dobre praktyk...
Sztuka programowania 1504 dni, 11 godzin temu 242 rozwiń
Polecamy
Nadchodzące wydarzenia
Najaktywniejsi
.Net
.net core
architektura
ASP .NET
asp.net
Asp.Net Core
ASP.NET MVC
Azure
C#
C# .NET
certyfikacja
certyfikat
daj sie poznac 2017
Daj się poznać
Daj Się Poznać 2017
dajsiepoznac
design patterns
dotnet
DSP
dsp2017
egzamin
Entity Framework
F#
git
JavaScript
jQuery
konferencja
Linq
mvc
MVVM
Narzędzia
performance
praca
programowanie
project management
SharePoint
Silverlight
SQL
sql server
TDD
testy
Visual Studio
Visual Studio 2010
WCF
Windows
Windows 8
windows phone
WPF
Wzorce projektowe
Xamarin