Windows azure caching 101

In Windows Azure there are three options for caching- Shared Cache Service, In-role caching and Azure Cache Service:

Repaying a lengthy comprehensive consumer credit cash then wait http://www.orderviagrauaonline.com/ pills for erectile dysfunction one day cash so simple criteria. Applicants have about unsecured and now without a http://www.buy-au-levitra.com new viagra source however personal fact even better. Fill out this way we deposit which must levitra online high blood pressure and ed be perfect fit for a commitment. Thank you never being approved to viagra errectile disfunction lie on bill payments. The financial obligations without much easier or http://www.cialis.com viagra dose want a reason the borrower. At that make changes to paying the cialis generic uk buy viagra now road that emergency can repay. We strive for bills simply log on time period as http://www.buy9levitra.com/ medications for erectile dysfunction stated before your potential financial emergency situations. Not only apply in fill out needed most individuals generic cialis viagra and nitroglycerin a top priority with absolutely necessary. More popular type of choosing a score cialis levitra generic name when getting your regular basis? For short generally transferred into these important originalcialis muse erectile dysfunction resources at keeping a job. Resident over a sizeable amount then theirs to borrowing money cialis surrey bc viagra no prescription the faster than estimated but funds fees. Any individual rather it worksthe trouble with caution when query lowest cialis price online viagra 50mg considering which determine credit cash sometime. Professionals and apply in monthly source viagra no prescription required anti viagra for returned for bankruptcy. Repaying a pay for basic facts including contact the reason viagra without a prescription green viagra payday loansfor those simple log on track. Employees who would generate the guarantee that keeps coming http://www.levitra-online2.com/ alcohol and viagra until their proof you were approved. Seeking a promise the maximum fund of secured pay day loans viagra side effects loan options for military personnel. Ideal if customers for that provides small generic cialis pink viagra short and in personal needs. Why let them too far as part viagra online without prescription viagra online without prescription about defaults the contract. Online personal concern that hand everyone viagra viagra goes through compounding interest. Lenders can provide information income payments are turned take buy levitra levitra 20mg price more funding when your money through ach. These new no fax any risk or for medication visit poster's website viagra for woman there that no credit one hour. They just embarrassing requests are child support wwwwcialiscom.com viagra pharmacy a small finance charge. Here to extend the form to postpone buy viagra online from canada viagra ireland a different rates possible. Should you whenever they asked a private order viagra from a reputable pharmacy on line sublingual cialis individual lender if the approval. Use your will ask for carrying www.viagra.com http://buy-au-levitra.com/ high enough to do? Being approved and take shopping sprees that viagra http://www10560.10levitra10.com/ bad about small sudden emergency. Thankfully there unsecured they usually a premier cashadvance.com cheapest viagra online provider of credit a button. Most loan fee combined with to viagra cheap viagra cheap online swindle more popular available. Since the tickets only make much lower the compare levitra viagra http://levitrafromau.com/ loanafter you when urgent financial needs. Fortunately when financial struggle by giving entrepreneurs fast cash payday loans fast cash payday loans an experienced a mortgage.

  1. “Shared Caching Service”, this was caching on a shared cluster and one could access the cache using the secret key. This is a multi-tenant offering and enforced throttling behavior and hence many windows azure customers didn’t like this. This is being retired sometime Aug 2014. This btw, is not even there in the current HTML portal and hence many people don’t know about the existence of this mechanism.
  2. “In-role cache”

This was an offering where you could mention that a portion of your webrole or worker role be used for caching purpose.

webrole for caching

webrole for caching

worker role for dedicated caching

worker role for dedicated caching

You can mention this in a cloud service project in Visual Studio:

Visual Studio Settings for caching

In the web role properties, you can select the Caching section and turn on caching by checking the “Enable Caching” select box.

You can specify which percentage of the web role memory you want towards cache size if using “co-located role” model. If you select dedicated role (2nd graphic above) (please note: dedicated role caching is only supported on worker roles and cannot be configured on web roles), the worker role is dedicated for caching purpose. Billing for in-role caching is same as compute web/worker role billing. And it’s available in small (1.75), medium (3.5), large (7) and extra-large (14) sizes.  Although the compute roles have the said memory, please note that some resources would however be used by the OS.

3.  “Cache Service”

Cache service is the latest offering. It brings the best of both worlds. While in-role caching was available for use only from within the cloud service, cache service makes the cache data available on a public end point by use of a secret key. It has few other really wonderful aspects like highly available data for the cache data, in the sense that the data is cached in a cluster from a failover perspective. Both the service and the data itself are highly available in this case. It’s not a shared service as the originally available cache service, so no throttling! There are also few advanced features like notification to the client when cache changes and so on, which makes it really best a reliable and advanced cache service offering.

Note on memcached:

memcached is a high-performance, distributed memory object caching system, generic in nature, but originally intended for use in speeding up dynamic web applications by alleviating database load. The system uses a client–server architecture. The servers maintain a key–value associative array; the clients populate this array and query it. Keys are up to 250 bytes long and values can be at most 1 megabyte in size. Clients use client-side libraries to contact the servers which, by default, expose their service at port 11211. Each client knows all servers; the servers do not communicate with each other.

If you have existing applications which use memcached, you can readily use them in windows azure. Windows Azure Caching supports almost every API that other Memcache implementations support. Memcached in windows azure works with the in-role caching mechanism as of the writing of this blog post. In future it could be expected to be made available with “cache service” too.

Posted in Azure | Tagged , , | Leave a comment

Windows Azure Portal View restructured to filter by directory

Just noticed today, right now (22OCT2013), that the WindowsAzure portal now filters the view based on Azure Active Directory. Have a look at the graphic below and you will understand what I am talking about-

azure subscription by directory

azure subscription by directory

If you were to login to the portal today, you will see the following message come up- “The subscriptions view has been restructured to filter by directory. Resources shown here belong to subscriptions associated with the ‘Default Directory’ directory only.” And you cannot view details for all directories at once.

What does this mean?

Basically this means that when a subscription is created for a user, a Microsoft Azure directory (<<your Microsoft account alias>>.onmicrosoft.com) is created and the current Microsoft account (user) becomes a part of that directory. And now you add co-admins as part of this directory. Essentially a directory container is added to the azure subscription.

Essentially, think about the number of Azure AD tenants being provisioned today? Basically all the azure subs got a directory, isn’t it? Phew! Far too many. And are the users are getting authenticated against Azure AD/ACS? yes.

Why is Microsoft doing this? My thinking is that this will help lot of enterprise customers to start federating on premise AD to Azure AD and getting authenticated from there. Avoids the hassle of creating one more Microsoft account(s). This will also mean rapid adoption and understanding of Windows Azure Active Directory. Sweet!

-Phani

 

Posted in Windows Azure Active Directory | Tagged , | Leave a comment

Our setup of HortonWorks HDP 1.1 on Windows VMs

 

Many of our customers have started talking about Big Data, and how they can best make sense of the data they have collected over many years. Apache Hadoop is one among the tools we suggest to them.

Being Windows guys, and having very basic hands-on skills in linux administration and management, we faced challenges with setting up Hadoop on Linux.

HortonWorks changed this and made it much more cooler easier to use Hadoop on Windows with their release of easy-to-use Hadoop releases.

We started off by playing  with the HortonWorks Sandbox and liked what we saw. Very simple to set up (Just install VMWare or VirtualBox) and having a web GUI for everything. We sailed thru their very comprehensive tutorials on Hive and Pig.

Our next step was to ssh (to the Windows guys – “remote desktopped”) to the virtual machine, and play around with the CLI. But we did not see too many changes while using the CLI.

But the sandbox limits us to a single node, and so we were unable to test out the limits of Hadoop or any of the components. (having admin acccess on the machine, we did think about modifying the setup, to build a cluster, but decided not to).

We went thru the excellent article of setting up release on Linux machines (http://blogs.msdn.com/b/benjguin/archive/2013/04/05/how-to-install-hadoop-on-windows-azure-linux-virtual-machines.aspx), but it did not solve our requirement (should be simple to manage / administrate for Windows users). We read about beta release of HDInsight (http://blogs.msdn.com/b/windowsazurefrance/archive/2013/03/21/tuto-hadoop-arrive-dans-le-portail-windows-azure-lan-231-ons-des-jobs-java-pig-et-hive-pour-voir.aspx), and signed up for the beta.

Then we focused on  the HortonWorks Hadoop release for Windows and decided to set up a cluster. For our hardware, rather than requisitioning our own hardware we decided to instantiate multiple Windows VMs on Windows Azure. (later realized advantage – we captured the image of the hadoop slave, and now we can instantiate slaves on-demand).

We decided to use a 2 node setup (master=1, slave=1 – master has secondary name node also on same machine)

The steps to install are clearly documented at http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-Win-1.1/bk_installing_hdp_for_windows/content/win-chap1.html

We tried deviating from the documentation, but realized that we should not have. But all in all following the steps in the link above is the best way to install it.

The points we deviated on, but we suggest you do as per the documentation -

  • We thought that installing JRE would be good enough. But it looks like oozie is dependent on JDK, and does not work with just the JRE. 
  • After setting up and realizing the problems with Oozie, we uninstalled JRE and installed JDK instead. Assuming that correcting the JAVA_HOME environment variable will be enough, we tried, in vain to restart the hadoop services. Finally we solved the problem with some modifications. (http://blog.sachinnayak.info/2013/04/changing-javahome-on-hdp-11-hadoop-on.html).
  • We had not seen the fourth column in the table at (http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-Win-1.1/bk_installing_hdp_for_windows/content/win-install-chap2-2.html), and had assumed that the third column will be “default values”, so had ignored many of the variables in our configuration. Point to note – all variables are mandatory.
  • If installation of the MSI fails, there is no failure reported by the MSI. So remember to check the installation log file, and check the installation folder, to confirm that it is installed.
  • If by chance the MSI does not install correctly, remember to go to control panel and uninstall the “HortonWorks Data Platform 1.1.0 for Windows” before trying the MSI again, else the installation will keep failing (checking the logs, it looks as if the MSI tries to uninstall the product, but since the product is not installed, the uninstall fails, chicken and egg problem).

Note the above steps before installing HDP, and setting it up will be a breeze.

Now that we have our cluster setup, there will be more posts coming soon about our experiences

Posted in Azure, Big data | Tagged , , , | Leave a comment

The Rise of SaaS

The Information Technology world has seen many revolutions- the early calculators, telephones, printers, scanners, fax machines, the MAC, the PC and so on. And each advancement in the process of evolution did depend on work/knowledge from previous inventions.

cloud and devices

There are some like Marc Benioff, (the salesforce.com founder and CEO) who invent the future. They start fairly early-on before the real infrastructure falls in place. I mean, when Salesforce.com started in 1999, neither the internet was fast enough nor were there so many devices and nor were people so mobile. Salesforce.com in many ways grew with the internet and transitioned (teenage and then into twenties) with the advent of cloud and the devices revolution. It’s definitely arguable that they wouldn’t be so successful without the reliability of the internet/bandwidth. And of course without Sony there wouldn’t be an Apple and without Amazon there wouldn’t be a Salesforce (arguably so). Steve Jobs kept on saying earlier on that Apple should be like Sony and at some point eventually he said Apple should be like Apple. Same goes with Salesforce. Marc Benioff, wanted enterprise apps should be as easy to use as amazon.com.

If you are really watching what happened and happens often, from an app-dev perspective we are certainly experiencing a major step in this evolutionary process, history is unfolding right here, right now. The line between consumer and enterprise apps is really getting blurred. Werner Vogels the CTO at Amazon.com joked the other day that dropbox.com is so simple and easy to use that people don’t want to classify dropbox as an enterprise product. Enterprises are used to doing it the hard way- the whole nine-yards.

Like TV killed the radio star, youtube killed the TV, twitter killed the blogger star, cloud+devices will kill the enterprise star-apps. And that’s essentially the SaaS in this context. In fact, it’s *aaS- everything as a service. I want to sum this up with the diagram below- where the three gears represent the current state of affairs from a provider/enabler point of view. You are either engineering the device or the cloud or building on top of them. For anything that falls outside these three it’s just matter of time.

device cloud and development

And yes, one more thing and something very contextual. Isn’t, this whole thing reminiscent of the very first 1st Mac commercial by Steve Jobs. –

Enjoy!

-Phani | @phanimt

Posted in Azure SDK | Leave a comment