Tuesday, 10 September 2019

New to KQL? No problem its just like SQL

Well KQL is a query language used to query on Kusto, which is covered in the post Getting started with Kusto.

One Cluster can have multiple Databases and one Database can have multiple Tables. Before going forward let us assume we have a cluster named 'cluster1' and it has database with name 'database1' and database has tables with names 'table1', 'table2', 'table3','table4', 'table5'.

A kusto query usually comprises of  multiple operators and table or cluster name. Unlike SQL table name is not the first thing to be written in KQL. Below is a sample kusto equivalent of select top 5* from table1.
table1 | top 5

Since we are going to query on a big data source lets just add count or where clause to all our queries.

List of  5 basic operators to get started:

1. Project: To select the list of columns to show from the table.
example: table2 | project col1, col2 | take 10.

2. Count: To count the number of rows.
example: table1 | count.

3. Where: It is similar to where clause in SQL server. In KQL we use double equal, unlike SQL, for conditional check.
example: table2 | where col1 = = 'anyvalue'.

4. Take: It picks the number or rows mentioned. It takes rows in no specific order. It is suggested to sort the rows before using take. Limit can also be used for the same purpose.
example: table1 | take 5.

5. Sort (asc/desc): It is used for sorting the data in ascending or descending order, just like SQL.
example: table3 | take 5 col1 asc or table3 | top 5 col1 desc.

You can check out all the available operators/functions/entities at the Microsoft docs website.

Please share your thoughts in the comments below.

Monday, 2 September 2019

Getting started with Kusto

What is kusto?

Well that looks like a difficult question to answer and its not answered clearly (atleast I was not able to find any answer for it). There are many versions of it.Some says its a tool, some says its a query language, docs says its a service. Lets, go with the docs version. Its a service to query over Big Data.
"It is based on relational database management systems, supporting entities such as databases, tables, and columns, as well as providing complex analytics query operators (such as calculated columns, searching and filtering or rows, group by-aggregates, joins)."

What is KQL?
KQL is acronym for Kusto Query Language, which can be used to query Azure Application Insight data. There is an open data source available online to query, it can be located at LogAnlytics.

How to Query?

Well to query you first need to learn the basics of KQL but dont worry if you already have worked with SQL or know about T/SQL, its easy to use. The syntax is little similar but there are few new keywords which might need to learn. New way of querying, it feels like mixture of SQL and Powershell to me. All the keywords are separated with Pipes '|' and output from the first query is input to the next one.
"A Kusto query is a read-only request to process Kusto data and return the results of this processing, without modifying the Kusto data or metadata. Kusto queries can use the SQL language, or the Kusto query language."
Where to write Query?

The next part is where can you write the query? Well kusto provides many ways/channels to query the data. All of them are mentioned below. Please select the one that suits your requirement. 😊
As I have mentioned in the article before about LogAnalytics. You can use a web UI to query or you can download Query Explorer. Well you can query over the application insight of your azure subscription also.

There are client libraries available in few languages, There is also an option to connect via Rest API, Client SDK's and KustoExplorer is an available native tool.

    .NET SDK
    Python SDK
    Java SDK
    Node SDK

The content for Kusto can be found under names of Azure Data Explorer, Azure Log Analytics etc.
Please share your thoughts in the comments below.

Wednesday, 1 May 2019

Microsoft is using Kestrel in Production for the new ASP.NET website

I could not help but noticed asp.net is now redirecting to a new website which is a sub-domain of Microsoft.com, so I got interested to check how many redirects actually happens when I type asp.net in browser. This is what I found out.

So as its shown in the image below there are 3 redirects post which the new website opens up.

  1. http://asp.net
  2. https://asp.net
  3. https://www.asp.net

All of these are 301/Moved Permanently.

Another interesting thing I noticed is the server used is not IIS which was used before. Its Kestrel this time. Its the same server which David Folwer (who is also an awesome speaker) and Damian Edwards (used to pairs up nicely with Scott Hanselman on standup) mentioned a lot of time during ASP.NET community stand up.

The server is developed by the Asp.net team for .net core I believe and the new website runs on same.



It used to be a very important concept but looks like everything is taken care of nowadays by the framework. Still, I feel the need to mention the same as I found a lack of resources/ blog to guide about the process. what it means, how to do it etc.

what is serialization?

As per Wikipedia,

serialization (or serialisation) is the process of translating data structures or object state into a format that can be stored.

Serialization we do in usually is to convert our code to JSON/XML or converting JSON/XML code back to object. There is an awesome library available for handling JSON which is Json.Net. It is written by a guy named James Newton King who is from New Zealand and currently working at Microsoft on asp.net team.

I have planned a few post on same topic, out of which all deals with either converting your XML to the object of your choice or the object to the XML.

C# provides extensive support to XML, under the namespce System.Xml. More about the namespace can be explored at apisof.net

Wednesday, 24 April 2019

Build Habits which you want to continue as Lifestyle!

Today if you check any social networking site (Facebook, Instagram, etc.) there are tons of accounts which pretend to be something which they are not, and most of us gets fooled by their appearance and want to start doing some thing these people are doing for example starting a morning routine. A morning routing is a thing which a person do once after he wakes up and that time of the morning usually qualifies as the 'Self time' because there is no disturbance at that time of any kind, If you manage to wake up at 5AM then there are good chances that your neighbourhood will be asleep and you can work on something which is important to you and you like to get finished. There are lots of such videos out there which make you follow such routines and habits but the only thing is they don't last longer. The problem I see with this approach is 'Anything which doesn't comes from within you, will not be able to mould you'.

The Habits as I mentioned in the title, should be chosen wisely. Simply picking up a habit that doesn't even align with your work schedule or the goal which you have is not going to help you in any manner. you should think twice or even few more times if you feel its required before picking any habit as they have a negative impact on you when you don't follow through.

The habit should be chosen with all the awareness that you want to really change that aspect of your life to something better. There is a nice book by Author named Charles Duhigg Book is "The Power of Habit". If you really feel you have to changes something I suggest you to read that book.

Any habit worked upon seriously for a long duration throughout lifetime becomes a lifestyle. A few examples are:
  • A habit of brushing your teeth at night daily in a long run is a lifestyle you live by.
  • Waking up early to spend some time peacefully with your self is a lifestyle.
  • Reading daily before going to bed is a good habit or a lifestyle if pursued for long time.
  • Eating healthy food is a good habit but a proud lifestyle when you say I have not eaten any shit food in last 5 years.
  • Walking 10k steps everyday.
  • Going to gym 4-5-6 days a week is a habit and a lifestyle to follow. 
  • Writing a Journal.
what kind of  habit lifestyle do you care to build?

Tuesday, 2 April 2019

Scheduling meetings like a Pro!

It is a Sunday evening and a meeting reminder pops up on your mobile screen. It's damn annoying, but I have seen people doing it all the time. They schedule a recurring meeting without considering your weekend and that makes me go crazy. It's my day off, that meeting reminder popping on my mobile screen is the last thing I want to see.

This post is dedicated to those dummies who have certainly got promoted because of their hair greying but don't for sure know how to schedule a meeting.

For Office 365.

click 'New' on top left corner -> Calendar Event.

2. Fill in all the details you need. (Location, Title etc)
The title should be meaningful, something like 'Let's meet' doesn't make any sense if you are sending that invite to 5-10-20 people in your organisation. It has to make sense. Remember to cross-check your spelling because it is going to be there in the calendar for some time. You don't want to be wrong in that.
while adding people make sure you want them as an optional attendee or required one. Scheduling assistant can help you in determining whether the person you are inviting is available at that time.

Now the most important thing, making a meeting recurring without disturbing people at their weekend.

You can select 'Every workday' or select 'Other' from the dropdown if you want the meeting to occur on a specific day.

For MS Outlook.

Goto Home ->  Meeting. (Opens a popup dialogue)

Clicking on Appointment in the Meeting popup will open one more popup to help you schedule the appointment.

Recurring appointment - Daily.

Recurring Appointment - Weekly. It provides you with the option to select your weekdays.

Which Software/Application/Platform do you use to schedule meetings?

Thursday, 5 July 2018

.NET Standard: What it is and how to use

What really is dot net standard?  

Let me try to put it in simple words. We used to use different BCL's for different frameworks and remembering it is a tough job. So Microsoft once again has come up with a solution to help developers to put a little less load on on the brain to remember the API's. They have replaced all the BCL's with a common one which they are calling as .net Standard. 

.Net Standard 2.0 has around 32,000 API's. You can download the list from here or you can check it here at GitHub.

.Net Standard replaces Portable Class Libraries (PCLs) as the tool for building .NET libraries that work everywhere 

How to use it? 

If you have .net core installed on your machine you can start working on .net Standard just by creating a Class Library. Yes, the old Class library is now Class Library for .net standard. 

For those who understand pictures better or would like to read less. 

Above pictures are taken from a slide of Immo Landwerth. 

The table below can be used as the reference for writing a class library using the standard.

If you are choosing a version for writing .net standard, you should consider a trade-off which is the 
higher the version of .net standard more apis are available. Lower the version, more platforms have already implemented it.

You can follow .net standard on GitHub 

Below are the list of API's added newly in .net standard 2.0

Microsoft.Win32.SafeHandles 22
System 1,366
System.CodeDom.Compiler 46
System.Collections 335
System.Collections.Generic 23
System.Collections.ObjectModel 1
System.Collections.Specialized 281
System.ComponentModel 1,843
System.ComponentModel.Design 565
System.ComponentModel.Design.Serialization 155
System.Configuration.Assemblies 13
System.Data 1,587
System.Data.Common 907
System.Data.SqlTypes 971
System.Diagnostics 826
System.Diagnostics.CodeAnalysis 2
System.Diagnostics.Contracts 89
System.Diagnostics.SymbolStore 146
System.Diagnostics.Tracing 2
System.Drawing 520
System.Dynamic 226
System.Globalization 217
System.IO 309
System.IO.Compression 8
System.IO.IsolatedStorage 134
System.IO.MemoryMappedFiles 66
System.IO.Pipes 125
System.Linq 366
System.Linq.Expressions 50
System.Net 1,360
System.Net.Cache 52
System.Net.Http.Headers 20
System.Net.Mail 289
System.Net.Mime 75
System.Net.NetworkInformation 696
System.Net.Security 194
System.Net.Sockets 168
System.Net.WebSockets 188
System.Numerics 1
System.Reflection 403
System.Reflection.Emit 3
System.Resources 91
System.Runtime 12
System.Runtime.CompilerServices 190
System.Runtime.ConstrainedExecution 22
System.Runtime.ExceptionServices 6
System.Runtime.InteropServices 106
System.Runtime.InteropServices.ComTypes 15
System.Runtime.Serialization 486
System.Runtime.Serialization.Formatters 13
System.Runtime.Serialization.Formatters.Binary 23
System.Runtime.Serialization.Json 80
System.Runtime.Versioning 33
System.Security 124
System.Security.Authentication 11
System.Security.Authentication.ExtendedProtection 36
System.Security.Claims 206
System.Security.Cryptography 575
System.Security.Cryptography.X509Certificates 76
System.Security.Permissions 88
System.Security.Principal 41
System.Text 83
System.Text.RegularExpressions 31
System.Threading 330
System.Threading.Tasks 66
System.Timers 39
System.Transactions 223
System.Web 32
System.Xml 1,362
System.Xml.Linq 7
System.Xml.Resolvers 25
System.Xml.Schema 967
System.Xml.Serialization 943
System.Xml.XPath 261
System.Xml.Xsl 140