Skip to main content

Posts

Showing posts from March, 2016

Migrate data from Azure to on-premises data center using Azure Data Factory

In today post we will talk about Azure Data Factory. But we will try a different approach. We will not look on what are the cores features of Azure Data Factory and when you should use it. Let's take a real life example, when Azure Data Factory can make our life easier. Scenario We have a system hosted on Azure that produce each day 100GB of audit data. There is a requirement from our client, to move this data on his own data center, where he will archive the information on tape. Classical implementation     The use case is pretty simple, but in the same complex. To be able to offer a reliable communication between this two endpoints, you need to ensure that all content is copied on the client data center. For this purpose you could use different tools, base on what kind of storage you have (SQL, binary/raw data, documents and so on). In general, audit data can be found as raw data in binary files. In Azure you would use Blob Storage. Other types of storage like Az

Corporate Series: (1) Processes

This post comes as an observation on what is happening around us, in so called ‘Corporates’. I just realize that there will be more than one posts. There are many ideas and notes, that I want to treat them separately. Before going further, I would like to mention that this post doesn’t have a connection with the company that I work for. It is only the output of different discussions that I had with friends that work around the globe for different ‘Corporates’. Why I’m using ‘Corporate’ with ‘ ‘? These companies are usually under 1.000 people and try to play like a ‘Corporate’, but in reality they are not ready for something like this. They have complex process and don’t care to optimize them. They forget that behind a process is one or more person that will run it and a process needs to add structure, clarity and repeatability – not only power and control. For a ‘Corporate’ like this, an external audit or an external opinion from a consultant is not acceptable, is too expensive

5 Free Tickets Give Away for Cluj Innovation Days! Dont Miss Out!

At the end of this month (March 31, April 1st), ClujIT Cluster is organizing a local IT event dedicated to medicine and governance -  http://clujinnovationdays.com/ What is Cluj Innovation Days Cluj Innovation Days (CID) is annual event organized by Cluj IT Cluster aiming at consolidating the IT sector and creating new innovation based bridges among businesses, academia and the public sector. CID 2016 is the 4th edition of the conference and is addressing two main topics, medicine and governance, both among the most pressing issues of our modern society, while also looking at how these are more and more intervened with digital technology. Spreading over two days the conference program will include presentations and workshops designed to explore current trends, new approaches and innovative solutions in Digital Medicine and Digital Governance. More than 400 participants are expected to attend the event: representatives of the Romanian Government and of the European Commission, me

[Post Event] CEE Community Open Days 2016, Prague

This week I had the great opportunity to participate at  CEE Community Open Days 2016 . The CEE Community Open Days is an annual local event for Microsoft MVP Award and Regional Director Programs in Central and Eastern Europe, Russia and CIS countries. This year, the event was organized Prague, a great city, full with history and beautiful places to visit. On top of this, I had the opportunity to meet other MVPs from CEE (Central and Eastern Europe). At this event I was invited to speak about Azure Service Fabric. You can find the slide desk below. Also, I added some pictures from this event (made by others). First 13 steps to be able to design an application for Azure Service Fabric from Radu Vunvulea Pictures (all credits to the other MVPs:

(Part 2) Azure Service Fabric - Parent Child communication and cancellation

Part 1 -  http://vunvulearadu.blogspot.ro/2016/03/azure-service-fabric-parent-child.html Part 2 -  http://vunvulearadu.blogspot.ro/2016/03/part-2-azure-service-fabric-parent.html Solution 1 for the below problem can be found here:  http://vunvulearadu.blogspot.ro/2016/03/azure-service-fabric-parent-child.html . A few weeks ago I so an interesting question on MSDN forum that I think that is pretty common. In this post I will try to give a possible solution to this problem. Context : There are multiple instances of the same Restful Stateful Services that are running in parallel. A new instance is created by a 'parent service that also might specifies the action that needs to be executed. Problem : The parent service needs to be able to cancel the instance of our Restful Stateless Service based on external factors or based on the current state of the child. What we need Basically we need to: Store and map all the service instances that are created by a service St

(Part 1) Azure Service Fabric - Parent Child communication and cancellation

Part 1 -  http://vunvulearadu.blogspot.ro/2016/03/azure-service-fabric-parent-child.html Part 2 -  http://vunvulearadu.blogspot.ro/2016/03/part-2-azure-service-fabric-parent.html A few weeks ago I so an interesting question on MSDN forum that I think that is pretty common. In this post I will try to give a possible solution to this problem. Context : There are multiple instances of the same Restful Stateful Services that are running in parallel. A new instance is created by a 'parent service that also might specifies the action that needs to be executed. Problem : The parent service needs to be able to cancel the instance of our Restful Stateless Service based on external factors or based on the current state of the child. What we need Basically we need to: Store and map all the service instances that are created by a service Store in a specific location a state related to them Share their state with the parent service Give the ability to the parent to cancel a

Azure Development Environment - Event Hub and Throughput Units

Context Very often, the cloud services that are cheap are the one that will be the most expensive one at the end of the month. Not because there are hidden costs, but because people tend to use them without caring of costs - they say that are cheap and the price is low. Making a review to the last bill of the development subscription I notified that 25% of the costs of the bill are generated by Service Bus - more exactly by Event Hub. Event Hub Why this is happening? Each developer is using one or two instances of Event Hub to develop, test and validate different flows. Our scripts, that are generating instances of Event Hub will crease a new namespace for each new instance of Event Hub. In this context, for a team of 7 developers, you will end up with 14 different Event Hubs and Service Bus Namespaces. On top of this, you will have different environments, like DEV and TEST environment that will add another 3 or 4 instance of Event Hubs. In the end you can end up with 18 differe