+
C-rappy Cacophony

Monday, November 14, 2016

Gwen Ifill

I saw the news about Gwen Ifill passing away. Very sad to note that.
https://en.wikipedia.org/wiki/Gwen_Ifill

I remember going to one of her Speeches in Austin about 12 years ago. She was excellent.I saw her on TV as well recently before the elections. She was still eloquent.
May Gwen Rest in Peace.



Posted by rajesh |



Sunday, July 31, 2016

Testing Blog

I got reminded about my blog. i dont think I have updated it 4 years.
Several things ahve happened in the last 4 years. Dhwani has grown into a wonderful 6 year old kid. She is enjoying her vacation in India.
We have had our 2nd daughter Jahnvi. She is such a bundle of joy. We just love being with her and cherish all her antics. She being the smallest of the cousins gets a lot of attention and pampering from everyone in the family. She seems to be unique as well in her way of saying things or mannerisms. Completely enjoyable.

I have moved 3 different jobs in 4 years. Moved from Dell to Sandisk and then moved to Hitachi Data Systems. Shwetha has moved from VMWare to Cadencc.

-Rajesh


Posted by rajesh |



Monday, December 03, 2012

Life of Pi

Life of Pi  12/1/12

Warched the movie Life of Pi yesterday. I had a lot of expectations from having watched the trailer of the movie a number of times during prior movie outings. The vivid images of the a young boy getting shocked by a zebra trying to swim and escape frim te deck of a ship and his tryst with a ferocious tiger in a lone boat , the amazing way the mere cats run frantically in a group in the island and the beautifully cast Indian temple with fliating diyaa lights were part of the trailer which enthused me to go and watch the movie in the theatre. The opening of the movie also was stunning as it started as if it was a tamil movie with a Traditional tamil song set in Pondicherry. This was followed by the introduction of a host of characters who too were Indians. Just as I imagined this to be another "Namesake" kind of movie I was confronted with surprise and shock The indianness of the movie just stopped right there and suddenly the movie got hijacked into this castaway mode.
  • As the movie evolved I found that the awe inspiring trailer elements were the only most interesting moments in the whole movie as well. May be a couple of more scenes such as the moments that Pi spends with the tiger, the flying fishes in the middle of the ocean and the amazing colorful scenes in the floating island.
  • But other than these scenes I dont have much anecdotal scenes or interesting moments to remember just a day after watching the movie. May be my expectations of ship wrecked and survival kind of movies comes from the movie cast away which had many elements such as the fedex box and the soccer ball wilson which are still now etched in my minds after a decade from watching that movie.
  • Having said that, Life of Pi was still a very well made movie which just did not live much to the hype.I wish there were more juicy elements added to it when Pi is stranded in the middle of the sea or when he gets to alight on the floating island. The relationship of Pi and his attachment to the tiger could have been Made a bit more poignant. The tiger was throughout shown to be a ruthless emotionless creature that kept growling and trying to pounce on Pi. May be it should have been shown to be tamed and much docile as it understands Pi's concern for keeping it alive through his efforts to find fishes or provide shelter from the raving waves in the boat.
  • The director might have tried to stick to the original story from the book that this movie has been adapted but if he had the liberty to introduce changes to the script I think he could have shown the elderly Pi getting back to where he finally reached land and reuniting with the tiger or Pi going back to India looking for his lady love Aanandhi and probably even recreating a zoo as how his father had done earlier. May be Indian cinema has spoilt me with such happy endings but then the way Life of Pi ended seemed so abrupt and pointless. I didnt understand what the purpose of the whole narration from Irfan Khan was for. What was the connection of Pi and the bharatnatyam sessions and his love scenes? The bit about God, the church visits and Pi's ridicule at school for his crazy name were also a bit confusing and not gelling with the purpose of the movie.I feel Tabu and Irfan Khan had been wasted in the movie. They are brilliant actors who could have been made memorable role players in the movie rather than act like some stage drama charaters just mouthing out lengthy dialogues.Tabu's tamil pronunciation in the few scenes she came were attrocious.
  • Finally what is the message from the movie? May be it is not meant to have any message but it tried to dabble across many issues such as religion, vegetarianism, cruelty to animals from being in captivity at zoos/when they get transported across the world and also about the lack of compassion and common sense in wild animals. There was also this half baked attempt at saying that one can survive in a lone boat with a wild animal if one acts shrewd and doesnt lose hope.


  • Sent from my iPhone


    Posted by rajesh |



    Tuesday, July 31, 2012

    Big data... Hadoop and such

    What is "Big Data"?
    The short answer is that size does matter after all.

    Sometimes big data is measured in terabytes, petabytes, or more. In the real world, it's usually measured in frustration, annoyance, anxiety, and money down the drain. 

    Data becomes "big data" when it basically outgrows your current ability to process it, store it, and cope with it efficiently. Storage has become very cheap in the past decade, which means it has become easy to collect mountains of data. However, our ability to actually process the mountains of data quickly has not scaled as fast. Traditional tools to analyse and store data -- SQL databases, spreadsheets, the Chinese abacus -- were not designed to deal with vast data problems.

    The amount of information in the world is now measured in zettabytes. A zettabyte, which is 1021 bytes (that is 1 followed by twenty-one zeroes), is a big number. Imagine you wrote three paragraphs describing your favorite movie - that's about 1 kilobyte. Next, imagine you wrote three paragraphs for every grain of sand on the earth -- that amount of information is in the zettabyte range.

    You may "only" have some number of terabytes in your databases, but you still have a lot of data to work with. And that number is only going to balloon in size every year.
    It is not advisable to dig out the hole for a pool using only an ice cream scooper; you need a big tool.

    What is this Big Tool for Big Data?


    Hadoop is the best tool available today for processing and storing herculean amounts of big data . Hadoop throws hundreds or thousands of computers at the big data problem, rather than using single computer.

    Hadoop makes data mining, analytics, and processing of big data cheap and fast. Hadoop can take most of your big data problems and unlock the answers, because you can keep all your data, including all of your historical data, and get an answer before your children graduate college.

    Apache Hadoop is an open-source project inspired by research of Google. Since you were wondering, Hadoop is named after the stuffed toy elephant of the lead programmer's son. This explains the preponderance of pachyderms wherever Hadoop is mentioned

    In Hadoop parlance, the group of coordinated computers is called a cluster, and the individual computers in the cluster are called nodes.

    What is Hadoop good at?

    Hadoop is awesome:

    Hadoop is cheap. 
    Hadoop is an open-source Apache project, which means anybody is free to use it. Hadoop runs on commodity hardware (i.e. normal everyday computers), so you don't have to buy million-dollar specialized database machines.

    Hadoop is fast. Hadoop can deal with terabytes of data in minutes, and with petabytes in hours. Hadoop is the only way that companies with gigantic amounts of data like Facebook, Twitter, Yahoo, eBay, and Amazon can cost-effectively and quickly make decisions.

    Hadoop scales to large amounts of big data storage. Need to add more space? Just add more hard drives to a node, or even add more nodes to your cluster. You never shut down Hadoop.

    Hadoop scales to large amounts of big data computation. Is your cluster slow? Just add more nodes to spread out the computation. Hadoop scales almost linearly in many cases - this means you can halve the time it takes to do a job by doubling the number of compute nodes.

    Hadoop is flexible with types of big data. Are you dealing with structured data? Great. Do you have semi-structured or unstructured (document-oriented) data? Lovely. Hadoop stores and processes any kind of data.

    Hadoop is flexible with programming languages. Hadoop is natively written in Java, but you can access your data in a SQL-inspired language called Apache Hive. If you want a more procedural language for analysis, there is Apache Pig. If you want to get deep into the framework, you can custom-analyse your data by writing code in Java, C/C++, Ruby, Python, C#, QBASIC or anything else.

     
    What is (Plain) Hadoop bad at?


    In the real world, just downloading Plain Hadoop from the Apache website and trying to use it has some shortcomings:

    Plain Hadoop is hard to to set up. Have you tried setting up this thing? Your best bet may be to kidnap some professors and press them into your service.

    Plain Hadoop is hard to manage. How do you do anything? Where is the graphical user interface? Oh, there is none.

    Plain Hadoop is hard to keep alive. Hadoop has various single points of failure. When Hadoop collapses, you lose data and you lose time. That hurts.

    Plain Hadoop is hard to use. Seriously, this is not a joke. Even adding up a list of numbers is painful.

    Plain Hadoop is not secure. Your files are not secure and users can easily corrupt or steal data. I hope you trust everybody.

    Plain Hadoop is not optimized for your hardware. Hadoop does not run at full capacity for your hardware, which is like being stuck in second gear.

    The good news is that you can have all the good parts of Hadoop with none of the bad parts.

    Zettaset Big Data is a faster, more reliable, easier, and secure Hadoop.

    Zettaset Big Data is just better.

    Rajesh Vijayaraghavan





    Posted by rajesh |



    Sunday, June 10, 2012

    Appa amma in Boston 2012

    >
    > These pictures were sent with Picasa, from Google.
    > Try it out here: http://picasa.google.com/


    Posted by rajesh |



    Thursday, June 07, 2012

    Dreamworks Maximizes Storage

     
     

    Sent to you by raapi via Google Reader:

     
     

    Dreamworks Maximizes Storage

    via Inside IT Storage » SSD by Barbara Craig on 6/6/12

    With Madagascar 3 being released this Friday, thought it would be of interest to the community to see just how much data is required to produce a 3D film. At HP's Discover event in Las Vegas today, the crowd of over 10,000 was enlightened to learn that:


    • Dreamworks has released over 20 animated films worldwide to date.
    • Have 10 films in production at any given time.
    • And each film takes 5 years to develop.
    • Requiring over 400 artists and technologists to create.
    • Who collaborate virtually worldwide.
    • And together the filmmakers produce 130,000 frames of animation.
    • With every frame going through multiple departments.
    • Creating a frame that contains hundreds of layers.
    • Resulting in half a billion digital files for each and every film.
    • Requiring high performance computing.
    • With over 200 TB of data.
    • For more than 60 million render hours.
    • With over 15K cores of computing power.
    • Stored securely in the cloud.
    • All powered by HP.
    For more information, launch the video.


     
     

    Things you can do from here:

     
     


    Posted by rajesh |



    Friday, May 25, 2012

    Seagate enterprise tiered storage decoder ring

     
     

    Sent to you by raapi via Google Reader:

     
     

    Seagate enterprise tiered storage decoder ring

    via Inside IT Storage by Mark Wojtasiak on 5/21/12

    It's a bit of an understatement to say that enterprise storage is complicated.

    Seagate alone has 7 different drive families in the enterprise storage space with 26 capacity points, and 101 model numbers. Everything from SSDs to hard drives, encrypted to non-encrypted, FIPS to non-FIPS…the landscape can be daunting for anyone to navigate.

    You might ask:  Why so many options?  Can't we just have one or two drives that meet the demands of enterprise servers and storage?  This used to be the case when there was simply Seagate Cheetah 10K back in the late 90s early 2000s. Times have changed…enter the realm of:

    Tiered Storage

    By definition tiered storage "is the assignment of different categories of data to different types of storage media in order to reduce total storage cost. Categories may be based on levels of protection needed, performance requirements, frequency of use, and other considerations," according to SearchStorage.com.

    What "drives" data's level of protection, performance requirements, frequency of use, etc. is largely the applications creating and delivering that data, as well as the nature of the data itself, and how quickly, and how often it is needed.  The idea being that the less often the data is needed, the more it should reside on lower cost, higher capacity storage.  The most mission critical data being at the highest tier (Tier 0) – commonly called "the SSD tier," and the least accessed being in the lowest tier (Tier 3), commonly termed "the archive tier."

    To simplify things – consider this visual by Seagate:

     


     
     

    Things you can do from here:

     
     


    Posted by rajesh |



    The evolving cloud and how it impacts storage – Part 2 of 4

     
     

    Sent to you by raapi via Google Reader:

     
     

    The evolving cloud and how it impacts storage – Part 2 of 4

    via Inside IT Storage by Mark Wojtasiak on 5/24/12

    This past March, Wes Perdue, Seagate's  Director of PLM Cloud Strategy at Seagate spoke at World Hosting Days in Europa-Park Rust, Germany.  The topic: The Evolving Cloud and How it Impacts Storage.  We have taken the transcript of Wes's presentation and created this 4 part series covering:

    Part 2: The Seagate Cloud Strategy

    From a strategy standpoint, Seagate is going to be the market leader and the technology leader, and in large part, we will be doing that by developing strategic partnerships.  Engaging with key partners, and through that engagement, understanding what their challenges and what their issues are, so we can bake that back into the product development process and optimize drives that better fit these applications.

    Engagement to Understand Requirements is Critical

    As we have these engagements; there are a lot of topics that we try to understand. We try to understand the differences and challenges and how they impact hard drives. We will be taking a deeper dive into each and talk about everything from the type of data center infrastructure to security to cold storage to architectures. It has been eye opening for us in the way things are done differently in this (cloud) space.

    Data Center Infrastructure

    Starting with the data center infrastructure.  You can have a 50,000 or 60,000 square meter data center, or a very small, modular, container type of data center, and what we've learned across the board is that it really doesn't matter the type. What really matters is the application and the architecture from a software standpoint that determines what storage device is needed for that application, or a given set of applications in these data centers.

    Data Center Environment

    In terms of environment, this has been a big trend or topic of discussion. The tier one service providers are building their own data centers, and just about all of them are deploying free air or fresh air cooling economizers for power and cooling efficiency.  Power and cooling is probably the number one operating expense in a data center.  They want to operate their data centers with this free air-cooling more days out of the year, as much as possible.  At one of Facebook's newest data centers in the northwest part of the United States, they did an environmental study.  They increased the chassis inlet air temperature from 25 degrees C to 30 degrees C, and they raised the relative humidity from 65 percent to 90 percent.  Then, they increased the delta-t temperature from 10 degrees C to 20 degrees C.  What this means to the drive is about a 50 degrees C case temperature. That's getting up there.  We see this trend continuing to occur, and we believe that drives, as well as all components in the system are going to experience harsher environments.

    Pushing the Workload Utilization Envelope

    In terms of workload utilization, a lot of infrastructures are virtualized; a multi-tenant infrastructure. As we talk to the cloud architects, a lot of them are in the process of revamping their file systems, their software stacks, and they want to improve the utilization of their key components.  They are basically saying, the workloads one year from now will look nothing like they do today.  And that peaks our interest. Think of it this way, whenever a processor isn't calculating, isn't processing, they (the service provider) are not making any money. Whenever a hard drive is not reading and writing, the service provider, again, is not making any money.  So what's ideal for them, what's nirvana is for the hard drives to read and write all the time, 24×7, no idle time which impacts us, because we use some of that idle time to do background checks, to do drive scans.  So, in addition to drives being used in harsher environments, they are going to be working even harder.

    Pushing the Efficiency Envelope

    Remember that story I told you about the delta-t study, the delta-t temperature increase?  The delta-t temperature is the temperature difference between the hot aisle temperature and the cold aisle temperature. That delta-t temperature put the temperature of the hot aisle at 50 degrees C, and the hot aisle is where the maintenance is done.  So, management said, we need to be kinder to our system admins, so they're going to do maintenance in the cold aisle.  That necessitated the need to change, a design change, that had to move all the cabling to go from one end to the other.  So guess what folks were able to respond very quick to that change, be nimble and adapt, and be very responsive to making that change for this tier one service provider?  Those builders, those integrators working side by side, very closely with these tier one service providers. What we have heard over and over again is this local high-touch technical support is critical to success.

    So in what ways is Seagate innovating for the cloud?  We'll cover that in the next post on Data Protection, Security, and Cold Storage in the Cloud.

    Stay tuned.

    Related Posts:

    The evolving cloud and how it impacts storage – Part 1 of 4

     


     
     

    Things you can do from here:

     
     


    Posted by rajesh |



    The evolving cloud and how it impacts storage – Part 1 of 4

     
     

    Sent to you by raapi via Google Reader:

     
     

    The evolving cloud and how it impacts storage – Part 1 of 4

    via Inside IT Storage by Mark Wojtasiak on 5/17/12

     

    This past March, Wes Perdue, Seagate's  Director of PLM Cloud Strategy at Seagate spoke at World Hosting Days in Europa-Park Rust, Germany.  The topic: The Evolving Cloud and How it Impacts Storage.  We have taken the transcript of Wes's presentation and created this 4 part series covering:

    • Part 1: Storage and the Evolving Cloud
    • Part 2: The Seagate Cloud Strategy
    • Part 3: Data Protection, Security, and Cold Storage in the Cloud
    • Part 4: The Cloud: Keys to Success

    Part 1: Storage and the Evolving Cloud

    The cloud space is very important to Seagate.  In fact it's a strategic imperative.  The service providers do things just a little bit different than their traditional IT brethren.  They push the envelope in a lot of different ways, increasing efficiencies, improving costs, and we're off as a drive manufacturer to fully understand those differences and what opportunities exist to optimize storage devices for this space.

    The WW Cloud Market

    From a storage growth standpoint, in terms of US dollars in billions, the worldwide cloud services market is approximately 100 billion dollars and in a couple years, it's approaching 150 billion dollars.  As a hard drive manufacturer, it's difficult to hard to get our arms around what this means from a capacity or a drive unit standpoint. But, what we know is that these services enable and drive new applications, and those applications need data, and they need storage.

    2011 Cloud Markets by Geo

    From a worldwide perspective, about 57 percent of the cloud services revenue is in the Americas, 19 percent in Europe, and the rest in Asia Pacific. If you had to look one area with the strongest growth, it's probably in Asia Pacific.  They have the smallest percentage, but the largest potential.

    Connected Devices need Servers

    Over the next few years, analysts are projecting 790 million smartphones and 300 million tablets will be sold worldwide. According to Intel, for every 600 smartphones, you need a server, and for every 122 tablets, you need a server.  So you need 1.3 million servers to support those smartphones. You need 2.5 million servers to support those tablets.  That's 3.8 million servers to support this mobile infrastructure.  And, servers require storage.

    Enterprise Capacity Demand

    So, how many drives? How much capacity in terms of enterprise drives that went into a cloud infrastructure.  Last year, 2011, 23 percent of enterprise capacity was for a cloud infrastructure. And in a couple years, that's projected to be 39 percent. Seagate does not contend that all data is going to go into the cloud, because the nature of some of the data, and/or the culture of some companies. In particular, with public clouds, there is just going to be data companies simply don't entrust to a third party.  They may create a private cloud behind their firewall within their four walls instead.  Still, we don't know that every piece of data created is going to be in the cloud at some point in time, but need less to say, a good portion of data will be.

    The Demand for Storage Devices

    What we do know is that this is driving a lot of storage devices.  By the end of the decade, we are looking at a billion hard drives, and over 200 million solid-state drives shipped worldwide.  If we project that more than half of these devices will be in the cloud in some way shape or form, it's important to understand how cloud service providers do things differently, and design such requirements into our products.

    We'll cover that in future posts in this series.  The next post will cover exactly how Seagate is strategizing around the cloud.

    Stay tuned.

     


     
     

    Things you can do from here:

     
     


    Posted by rajesh |



    ^



     © C-rappy Cacophony 2005 - Powered by Blogger Templates for Blogger