<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Ritika Trikha on Medium]]></title>
        <description><![CDATA[Stories by Ritika Trikha on Medium]]></description>
        <link>https://medium.com/@ritikatrikha?source=rss-cf3e272f885------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*P5EzkpNZfKhu6vs6wvKjJw.jpeg</url>
            <title>Stories by Ritika Trikha on Medium</title>
            <link>https://medium.com/@ritikatrikha?source=rss-cf3e272f885------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Mon, 16 Nov 2026 15:27:55 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@ritikatrikha/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[FinTech Ushers Banks into the 21st Century]]></title>
            <link>https://medium.com/@ritikatrikha/fintech-ushers-banks-into-the-21st-century-8f0ffa08b508?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/8f0ffa08b508</guid>
            <category><![CDATA[tech]]></category>
            <category><![CDATA[fintech]]></category>
            <category><![CDATA[finance]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 19:03:11 GMT</pubDate>
            <atom:updated>2015-09-20T19:03:25.458Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/760/0*KWjEAsFnxekBzt8Z.jpg" /></figure><p>It’s 2015 and most banking technology is awful. How many times have you waited in line at the bank for a simple transaction only to wait while the teller inputs your info in a 30-year-old clunky IT system. Chances are, most of your financial transactions are programmed in the 1959 <a href="http://www.etindy.com/blog/tag/cobol/">COBOL</a> language. In fact, you might get snail mail faster than an online payment from some banks who still use the <a href="http://thebillfold.com/2013/10/why-it-takes-so-long-in-the-u-s-to-transfer-money/">Automated Clearing House System</a> from the 1970s.</p><p>It’s kind of understandable. Proponents of the legacy systems say when you’re handling sensitive financial information for millions of people, it’s better to err on the side of safe than sorry. Plus, the cumbersome size and sheer expense of banking operations put limits on how much they can change. But that mindset is shifting…slowly…but surely. Over the past few years, there’s been a noteworthy spike in the creation of startups that are making financial transactions easier, cheaper and even safer.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/529/0*Bkvmq0P-CABh0rX4.png" /></figure><p>And it’s happening across the entire financial landscape, from the way we pay our friends (<em>can I just Venmo you?</em>) to the source of our investment advice <em>(robo advisors</em>). The last few years have produced a steady stream of cool, new technologies that will have our grandchildren look at ATM vestibules the way we look at record players. The following is a deep dive into what took the FinTech revolution so long and why it’s lighting a fire under the biggest Wall Street firms.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*TbesNOsJmSAXxpD9.png" /></figure><h4>Rising from the Ashes of the 2008 Meltdown</h4><p>For decades, big banks have enjoyed a forcefield of governmental financial regulations that prevent newcomers to easily come in and disrupt their operations. But when the market crashed in 2008, banks created a deep hole in consumer trust and support. The combination of distrust in big banks and tech advancements like Cloud computing, open source, encryption and machine learning has been a perfect storm for FinTech startups to rise to the occasion. For instance, even though back-office automation service Firm58 was founded in 2005, it didn’t really take flight until the crash in 2008.</p><p>For banks, Firm58 was a good, cheap solution to build much-needed visibility in banking operations. One article in <a href="http://certmag.com/developers-to-the-rescue-a-career-in-financial-services-software/">2009</a> in Certification Magazine interviews the CTO of Firm58 who explains:</p><blockquote>In these market conditions, I think a lot of these financial firms are trying to do a lot more with less. They’re not open to building in-house, proprietary systems anymore. They want to offload the IT cost; they don’t want to have a huge IT staff.</blockquote><p>Still, since the crash, scrutiny has been high, making the financial industry one of the hardest industries for startups to break through. Just look at what happened to peer-to-peer (p2p) lender Prosper. When people couldn’t get loans from banks, they naturally looked to p2p lending as an alternative. But in 2008, the Securities and Exchange Commission (SEC) issued Prosper a <a href="http://techcrunch.com/2008/10/16/prosper-and-other-p2p-lenders-get-squeezed-by-the-credit-crunch/">cease-and-desist letter</a> because the online platform did not register with the SEC. After closing shop for 9 months and paying $4 million in fees, they finally rerouted their business and are now rumored to follow competitor Lending Club into <a href="http://www.valuewalk.com/2015/01/prosper-marketplace-gearing-ipo/">IPO</a>.</p><h4>The JOBS Act Oiled the FinTech Engine</h4><p>The Jumpstart Our Business Startups (JOBS) Act in 2012 helped ease some hefty financial regulations. Because of the JOBS Act, anyone can invest in private projects just as if we were to buy stocks on NASDAQ. It opens up opportunities for companies to solicit publicly online and reach investors through new, 21st-century channels (like the Internet).</p><p>In fact, there are a host of new startups created dedicated to help FinTech startups navigate the startup world. <a href="http://groundbreaker.co/">GroundBreaker</a>, for instance, not only helps real-estate firms raise money using the JOBS Act but also advises clients on how to get their legal documents in order, structure their company, and handle compliance. The JOBS Act truly helped spring finance into the 21st century. And it’s not just about introducing more competitive, innovative startups in finance. It’s also about being able to adopt new technology that, in 2015, most of us take for granted.</p><p>For instance, the Cloud has become something of an extension of our professional skills, says Jake Marmulstein of GroundBreaker, but for most real estate professionals, the most sophisticated tech they use is Powerpoint and Email. In technology time, that’s akin to the stone ages! Real estate professionals traditionally couldn’t advertise or attract investors to their deals in a scalable way.</p><blockquote><em>“Crowdfunding is not a new thing for real estate professionals. Most real estate professionals raise money from a small pool of investors they know on a first name basis, or from institutional investors whose contributions count for a large portion of the needed equity in a transaction,” Marmulstein says.</em></blockquote><p>But thanks to JOBS Act, real estate professionals can extend and scale their investor reach online.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/471/0*EETEnwuAff6vDopq.jpg" /></figure><h4>Big Banks: ‘Silicon Valley is Coming’</h4><p>The spike of FinTech startups may not be enough to pierce a major hole and kill off the multi-billion dollar industry on which banks are built. But, they are forcing banks to innovate. In a letter to shareholders, JP Morgan Chase CEO Jamie Dimon acknowledged that the FinTech revolution is something they’re proactively aiming to compete with.</p><blockquote>“Silicon Valley is coming. Rest assured, we analyze all of our competitors in excruciating detail — so we can learn what they are doing and develop our own strategies accordingly,” Dimon says in the letter.</blockquote><p>Here’s what’s really special about FinTech: They are not only making finance faster and cheaper but also creating new services and security checks that couldn’t be made possible otherwise. For instance, new machine learning algorithms that scrape Big Data offer a more accurate way to assess a borrower’s risk level than the traditional loan officer at your local bank.</p><p>Goldman Sachs <a href="http://www.usatoday.com/story/money/2015/05/17/silicon-valley-wall-street-fintech/27321361/">predicted</a> that FinTech startups could threaten up to $4.7 trillion in revenue and $470 billion in profits from traditional Wall Street firms. Consider the fire lit under their feet. So, many big banks are making three strategic moves to stay relevant:</p><p><strong>#1 Big Banks Building Strong Tech Teams</strong></p><p>Big banks are creating their own new software platforms comparable to FinTech innovations. For instance, Charles Schwab recently released a free automated, algorithm-based portfolio advisor. This is basically a copycat of startups Betterment and Wealthfront. Likewise, Experian now offers an app that lets you track your credit on your smartphone…exactly like startup Credit Karma.</p><p><a href="http://www.goldmansachs.com/what-we-do/engineering/see-our-work/inside-symphony.html">Goldman Sachs’s Symphony</a> is the perfect example big banks’ focus on building in-house technology. Symphony is a cloud-based messaging workflow platform built internally for the firm. Most recently, they’ve even launched it externally as an open source platform as well.</p><p>To build quality new software, Wall Street has <a href="https://www.hackerrank.com/work/financial-services">grown their tech teams</a> significantly compared to just 10 years ago when banks were strapped for IT resources. Here’s a chart that breakdown the number of tech professionals versus total employees for two top banks today: Goldman Sachs and JPMorgan Chase. Both companies have more tech employees than Silicon Valley giants, like Facebook and Google!</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*g7h8GZuYN1SJ7o7U.png" /></figure><p><strong>#2 Can’t Beat ‘Em? Partner with ‘Em</strong></p><p>Big banks are also keeping enemies very close. For instance, Spanish bank BBVA Ventures recently acquired Simple, an automated budgeting and savings service. Similarly, both JP Morgan Asset Management and SunTrust Banks are investing in Prosper, mentioned above. With extremely deep pockets, it’s often easier for banks to swoop in and buy innovative startups than create their own. Plus, the innovative features that boost speed, cost and convenience only helps big banks grow their business in the long run.</p><blockquote>“Financial services-sponsored venture capital investment will continue to grow as institutions recognize that a go-it-alone approach of in-house development isn’t enough,” Jaidev Shergill, head of digital venture investing at Capital One, told <a href="http://www.banktech.com/management-strategies/report-global-fintech-investment-will-grow-to-at-least-%246-billion-by-2018/d/d-id/1297091">Accenture</a>.</blockquote><p><strong>#3 Let’s Build the Next Big Thing!</strong></p><p>When they’re not copying or partnering with existing startups, some banks actually launched their own startup accelerators to race to the forefront of innovation. Just in the past two years or so, HSBC, Wells Fargo and Santander all launched startup in-house accelerators, allocating hundreds of millions of dollars for FinTech startup investment. Barclays partnered up with TechStars, a startup accelerator. And Deutsche Labs has 3 innovation labs. The idea is, if some of these companies are successful, they’d become great vendors for the banks. Theoretically, it’s a win-win.</p><p>It’s been a long, treacherous road for techie entrepreneurs to breath some life into banks’ mainframes of the 70s and there’s still more to be done ahead. Beaten down by pre-Internet governmental regulations, FinTech startups of the past decade have helped pave the way for the outpour of stealthy new technologies for payments, lending, investing and much more. Finally, finance and technology seem to be moving together.</p><p>It’s sparking a slow, steady overhaul of banking technology. While FinTech startups could never obliterate the concrete, giant banks, they have forced them to start revving up their technological engines and, at least, start to catch up to the 21st century.</p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/fintech-ushers-banks-into-the-21st-century/"><em>blog.hackerrank.com</em></a><em> on June 8, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8f0ffa08b508" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Inevitable Return of COBOL]]></title>
            <link>https://medium.com/@ritikatrikha/the-inevitable-return-of-cobol-abdc0fcf9809?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/abdc0fcf9809</guid>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 19:02:33 GMT</pubDate>
            <atom:updated>2015-09-20T19:02:33.939Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/600/0*yDGzIKb23FI4Mk7L.jpg" /></figure><p>It’s only a matter of time until the Common Business Oriented Language (COBOL) will regain its spotlight as one of the most in-demand skills of future generations of software engineers. We can just see it now: Programmers of the future will hop out of their driverless cars, walk into their offices and sit down to start coding in 1959’s COBOL.</p><p>It sounds crazy, considering COBOL is the furthest thing from most engineers’ minds today. It ranks fairly low in the <a href="http://www.tiobe.com/index.php/content/paperinfo/tpci/index.html">Tiobe Index</a>, a measurement of today’s most popular programming languages. Many newer, speedier languages give today’s coders little reason not to scoff at the antiquated COBOL. The most telling evidence of COBOL’s irrelevancy is that about 70% of universities said they don’t even include COBOL in their computer science curriculum anymore, according to a <a href="http://www.computerworld.com/article/2496360/it-careers/should-universities-offer-cobol-classes-.html">recent survey</a>. It’s logical. Why waste <a href="http://blog.hackerrank.com/why-many-computer-science-programs-are-stagnating/">curriculum space</a> for a skill that employers don’t even look for these days? A quick search for “COBOL programmer” on any job site, for instance, yields a few hundred job postings while the more popular “Java programmer” yields thousands.</p><p>Based on these facts alone, COBOL appears to be nearly extinct. You might even wonder why we’re writing about COBOL at all? But looks can be deceiving. COBOL is a mysterious paradox. Born in another era, COBOL lives on as the quiet but important pillar on which the majority of businesses stand today. In a field that evolves at an unprecedented speed, younger generations may be overlooking a critical skill of the future.</p><h4>Out of Sight, Out of Mind</h4><p>Those of you who are familiar with legacy systems know the widely cited stat: *<a href="https://blog.hackerrank.com/fintech-ushers-banks-into-the-21st-century/">70–80% of all business transactions</a> worldwide are written in COBOL today. But what’s not emphasized often enough is there’s a slowly increasing gap between the number of massive institutions relying on COBOL and its relevancy among programmers today.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*DxP3KpPhZRKHJebF.png" /></figure><p>While newer programmers aren’t as interested in learning COBOL, its role in millions upon millions of mission-critical transactions from healthcare to travel can’t be denied. COBOL is written for mainframes created 10 years before man walked on the moon. Those same mainframes still operate some of the biggest institutionalized computing today. If someone pulled the plug on COBOL, millions of businesses worldwide would suffer from malfunctioning machines. This old programming language is a bit of a taboo today, but it’s important to recognize just how big of an impact COBOL still has on our day-to-day. Here’s a quick breakdown of the biggest systems that run on COBOL:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/795/0*XxxiewP1LBtqq6Ml.png" /></figure><h4>Why Haven’t We Replaced COBOL?</h4><p>If COBOL’s been such a foundational root of business apps for decades, why hasn’t something better come along? The short answer: If it ain’t broke, don’t fix it. The long answer requires us to take a step back in time. COBOL was created in 1959, the computing era when programming languages were tailored for specific purposes. For instance:</p><ul><li>Fortran → Scientific problems</li><li>Lisp → Artificial intelligence</li><li>Cobol → Business applications</li></ul><p>As banks, insurance companies and government institutions started joining the computer age, they’d create programming languages specific to their machines. You can imagine how costly and time-consuming this was. There needed to be a universal business language to carry out business operations faster.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/513/0*bPYZFMHus7i1to0h.jpg" /></figure><p>Grace Hopper, the mother of COBOL, helped champion the creation for this brand new programming language that aimed to function across all business systems, saving immense amount of time and money. Hopper was also the first to believe that programming languages should read just like English instead of computer jargon. Hence why COBOL’s syntax is so wordy. But it helped humanize the computing process for businesses during an era when computing was intensive and prevalent only in research facilities.</p><p>And so a new committee, consisting of industry, universities and US government folks, formed to develop the much-needed language to help standardize business programming. The Department of Defense even <a href="https://sites.google.com/a/plu.edu/cobol/">decreed</a> that all businesses must run on COBOL in the 1960s. One article by notable software engineer Robert L. Glass <a href="https://www.deepdyve.com/lp/association-for-computing-machinery/cobol-a-contradiction-and-an-enigma-1kXuEoZFx0?articleList=%2Fsearch%3Fquery%3DCOBOL%26page%3D2">explains</a> that COBOL does the 4 essential business tasks better than most modern languages today:</p><ul><li>The capability for heterogenous “record-structure” data</li><li>The capability for decimal arithmetic</li><li>The capability for convenient report generation</li><li>The capability for accessing and manipulating masses of data (typically made up of heterogenous data structure).</li></ul><p>“COBOL is either good or adequate in all 4 (except for database access and GUI construction, they were designed into the language from the outset), whereas the COBOL replacement languages, like Visual Basic and Java are good at few if any of them,” <a href="https://www.deepdyve.com/lp/association-for-computing-machinery/cobol-a-contradiction-and-an-enigma-1kXuEoZFx0?articleList=%2Fsearch%3Fquery%3DCOBOL%26page%3D2">Glass says</a>. And as language designers started to take more of a universal, flexible approach:</p><blockquote>“The unique capabilities of COBOL and the business reasons for them were lost in passage of time.”</blockquote><p>This was true as of 1997. So, at least until the late nineties, there really hasn’t been a successor that could carry out the massive batch processes as sturdily as COBOL.</p><p>But the even bigger reason not to rock the boat is the sheer size and cost of replacing billions of lines of COBOL that exist today. Many of these programs contain sensitive information about people, like social security numbers, banking info, credit card info and healthcare records. Creators of COBOL invested 2 trillion dollars for the universal language. Businesses worldwide run on over 220 billion lines of code today. It would be a herculean feat to replace every single business program with a brand new language without introducing detrimental bugs. Hence, the cost just hasn’t outweighed the benefits of replacing COBOL.</p><h4>The Case for the COBOL Comeback</h4><p>Although COBOL is currently out of sight and out of mind, businesses have to focus on restitching the antiquated fabric of their infrastructure…eventually. Consider the average age of the COBOL programmer today. <a href="http://www.computerworld.com/article/2554071/it-careers/cobol-coders--going--going--gone-.html">One survey</a> of IT managers from 352 companies finds:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*J4-En85gPrsIIphF.png" /></figure><p>That survey was taken 9 years ago. In 2014, Micro Focus says that the average age of COBOL programmer is still about <a href="http://www.computerworld.com/article/2554071/it-careers/cobol-coders--going--going--gone-.html">55-years-old</a>.</p><blockquote>“Without a doubt, it is a challenge to find a developer in Cobol who is not nearing retirement age,” says Dale Vecchio, research vice president of application development at <a href="http://www.gartner.com/">Gartner Inc.</a> “In 2004, the last time Gartner tried to count Cobol programmers, the consultancy estimated that there were about 2 million of them worldwide and that the number was declining at 5% annually.”</blockquote><p>COBOL programmers are starting to retire; meanwhile, there’s no interest from young programmers to take on COBOL challenges. So, what will businesses do to keep maintaining their mission-critical programs? COBOL skills will be in demand to reverse-engineer pivotal mainframes. And as time goes on, the market will need to correct this skill gap by boosting the value of COBOL programming skills, drawing more engineers to learning the language.</p><p>Some COBOL-heavy organizations, like IBM and Micro Focus, have already developed programs to promote COBOL in younger generations. So far, IBM <a href="https://www.ibm.com/developerworks/university/systemz/schools.html">has developed curricula</a> in association with more than 80 colleges and universities. Companies in Dallas are also doing something about it as well. Dr.Leon Kappelman, professor of Information Technology at the University of North Texas told <a href="http://blogs.wsj.com/cio/2014/10/02/cobol-is-dead-long-live-cobol/">the Wall Street Journal</a>:</p><blockquote>“Four years ago, local Fortune 500 employers encouraged the university to offer Cobol courses. Now, graduates who take Cobol electives earn starting salaries of $75,000 compared to starting salaries of $62,500 for those who did not.”</blockquote><p>Plus, many forums and online discussions about the language illustrate that…guys…it’s really not that bad. It’s important to note that, unlike modern languages, COBOL is not designed to be versatile. Once you adjust your expectation, COBOL isn’t as ugly. <a href="https://www.reddit.com/r/programming/comments/18g0im/cobol_will_outlive_us_all/c8f4xhq">Some programmers</a> enjoy the puzzle aspect of maintaining COBOL-based mainframes, like figuring out the exact line of code to fix an existing script. Others find the stable environment allows them to focus on the business aspects of the program. It’s why the few universities that offer COBOL courses mask it under “Intro to <a href="http://www.computerworld.com/article/2496360/it-careers/should-universities-offer-cobol-classes-.html">Business Systems Programming</a>”</p><p>As taboo as COBOL might be in the ping pong rooms of modern startup-driven culture today, its influence and irreplaceability will result in a spotlight on the dinosaur language again. Businesses must figure out who will maintain their mainframes when COBOL programmers retire in the near future.</p><p><strong>If you ran a COBOL-oriented business today, what would you do to address the looming skill shortage? Tell us in the comment section below!</strong></p><p><em>To get occasional notifications when we write blog posts, please </em><a href="http://eepurl.com/bozyBf"><strong><em>sign up for our email list</em></strong><em>.</em></a></p><p><em>* The 70–80% stat on total COBOL business transactions is an estimate based on </em><a href="http://www.eweek.com/c/a/Application-Development/From-the-Dustbin-Cobol-Rises"><em>Gartner</em></a><em> and </em><a href="http://blog.microfocus.com/news/cobol-the-language-for-future-generations/2470/"><em>Micro Focus </em></a><em>sources.</em></p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/the-inevitable-return-of-cobol/"><em>blog.hackerrank.com</em></a><em> on July 6, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=abdc0fcf9809" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How Programmers Freed Hollywood]]></title>
            <link>https://medium.com/@ritikatrikha/how-programmers-freed-hollywood-85ccba553cde?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/85ccba553cde</guid>
            <category><![CDATA[computer-science]]></category>
            <category><![CDATA[programming]]></category>
            <category><![CDATA[film]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 19:00:58 GMT</pubDate>
            <atom:updated>2015-09-20T19:01:42.741Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*84CYpQZhbd3cGqX_.png" /></figure><p>In Disney’s 1982 film Tron, software engineer Kevin Flynn is teleported inside a computer by the evil supercomputer Master Control Program. The camera pans over an endless arena with geometric 3-dimensional floating objects above a white grid. Surrounded by a neon-etched digital world, Flynn looks around and whispers in disbelief: “<em>Wow.” </em>At the push of a button, a laser rod appears in front of Flynn and he grabs the ends like handle bars. Within a split second, he’s propelled forward and inside a digitized Tron Lightcycle, battling two warriors in an endless maze. Voracious sounds of zooming cars are blaring.</p><p>This classic Tron Lightcycle scene was a phenomenal technological achievement in cinema. It marked the first extensive use of computer-generated imagery (CGI) illustrating the background, objects and movement in a feature film. For at least 15 minutes, Tron offered a glimpse into an unnatural world of boundless imagination and altered the way we visualized the world forever.</p><p>But who was the first to envision this new world and how did he push the limits that bring mind-bending innovations that pioneered the way to our favorite Hollywood films today, like Avatar, Transformers, Interstellar and countless other computer-generated masterpieces?</p><h3>Coaxing Magic from a Machine</h3><p>Before CGI made its debut in Hollywood, the <a href="https://www.deepdyve.com/lp/association-for-computing-machinery/the-story-of-computer-graphics-premiers-2VgA8EVW7p?articleList=%2Fsearch%3Fquery%3DThe%2BStory%2Bof%2BComputer%2BGraphics">first use</a> of computer graphics was flight simulation technology at the tail end of WWII to track enemy aircraft in the 1950s. The government needed graphics on a radar screen to identify incoming aircraft into US airspace for the first time.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/322/0*2AH1gwrpddGRWlMK.png" /></figure><p>The CGI technology first came from early tech company Mathematical Applications Group Inc. (<a href="https://design.osu.edu/carlson/history/tree/magi.html">MAGI</a>), which developed software, called SynthaVision, to evaluate nuclear radiation exposure. It used ray-casting to trace the source of the radiation, but folks at the company realized they could use the same process to trace light and create images.</p><p>When 26-year-old director Steven Lisberger saw a sample reel of MAGI’s CGI, he saw an opportunity to bring video game characters to life on the silver screen, inspiring the animated film, Tron.</p><blockquote>“I realized that there were these techniques that would be very suitable for bringing video games and computer visuals to the screen. And that was the moment that the whole concept flashed across my mind,” Lisberger <a href="https://www.questia.com/magazine/1P3-1297880551/the-making-of-tron">says</a>.</blockquote><p>But in the early 1980s, animators couldn’t just obtain CGI software off-the-shelf. They had to approach software engineers to write CGI programs from scratch. Most all studios were extremely hesitant about the futuristic idea. Warner Bros, MGM and Columbia all <a href="http://www.nytimes.com/1982/07/04/movies/special-effects-are-revolutionizing-film.html?pagewanted=2">turned down</a> the production of Tron largely because of the enormous cost and time for an uncertain outcome. But Disney, which was historically more inclined to experimentation, saw one demo of the CGI and took a leap of faith by investing $20 million into the creation of Tron.</p><p>And so, Lisberger, who was decades ahead of his time, set out to find the right programmers to bring his vision to life with technology that was yet to be created. It took a technological village. Four different computer companies banded together to create the visuals behind the 15-minute CGI scene over the course of a year. Lisberger recruited folks from early tech companies that specialize in graphics:</p><ul><li>MAGI</li><li>Triple-I</li><li>Robert Abel &amp; Associates</li><li>Digital Effects of NY</li></ul><p>Since there really was no “computer graphics specialist” job at the time, a combination of physicists, mathematicians, computer scientists and electrical engineers practiced the discipline at these early computer graphic companies. Each of the 4 groups had their own proprietary software for different aspects of CGI and worked in silos. While MAGI specialized in computer simulation of Light Cycles, Robert Abel &amp; Associates did the color vector animation, for instance. Robert Abel &amp; Associates’ <a href="http://tron.wikia.com/wiki/Richard_Taylor">Richard Taylor</a> was the visual effects supervisor and pulled the strings to help everyone get on the same page and speak the same language.</p><p>Tron’s CGI was largely created using the vector graphics machine Evans &amp; Sutherland Picture System on a PDP-11 computer with 2MB of memory and a disc holding not more than 330 MB.</p><p>It took hours to render each frame. And they <a href="http://www.swdfx.com/PDF/CG1_article_COWNovDec_issue.pdf">wrote</a> many brand new CGI programs specifically for each animation task. For example, the creative team really wanted Tron to look like the arena was a massively wide. Computer image choreographer Bill Kroye <a href="http://www.cgsociety.org/index.php/CGSFeatures/FeaturePrintable/tron">explains</a> how they companies made it happen:</p><blockquote>In real life you do that by softening the focus, and kind of dimming the colors. We came up with something that is very simple and I think is standard technique now in computer graphics which is called depth glowing. You assign a mathematical progression to the light of the points, depending how far away they are from the camera source. The farther away they are the less distinct they are, and that makes them look farther away. It’s something you automatically get in live-action photography. It’s something you have to mathematically apply to a computer image.</blockquote><p>Creating Tron helped create the future of CGI in Hollywood. In fact, many of the programmers who worked at Robert Abel &amp; Associates eventually went on to create Wavefront Inc., the first company to sell off-the-shelf CGI software.</p><h3>A Giant Leap Forward &amp; Three Steps Backwards for CGI Cinema</h3><p>Although Tron was a huge technological achievement in cinema, it tanked in the box office, which prompted Hollywood to generally close its doors to CGI. In fact, the Academy <a href="https://www.reddit.com/r/movies/comments/2r8pjl/til_tron_1982_was_disqualified_from_receiving_an/">eliminated</a> <em>Tron</em> from the Visual Effects Award that year because they said it was “cheating. That’s how fearful people were of computers in the 80s.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*lv5CotYeKyquFMpr.png" /></figure><p>At the time of its inception and several years afterward, Hollywood producers were leery of going into a deficit financing for expensive computer generated graphics. In 1988, director of <em>Outland </em>Peter Hyams <a href="https://www.deepdyve.com/lp/association-for-computing-machinery/the-reality-of-computer-graphics-in-the-motion-picture-industry-3SH8uQtBk4?articleList=%2Fsearch%3Fquery%3Dcomputer%2Bgraphics%2Bin%2Bhollywood">explains </a>the sheer risk of using CGIs at the time:</p><blockquote>“The thing that everybody detests about special effects is the amount of time, whether they’re done with computers or models or zebras, they’re terribly expensive and terribly slow…Ultimately someone goes and takes this very expensive piece of motion control equipment and it does what it does and the model flies just that way and you say ‘I don’t like it,’ and the guy says: ‘Well, that’s what was on the board, and that’ll be $35,000 please and it’s too late.”</blockquote><p>Plus, as innovative and spectacular as Tron was, many directors felt that CGI could never completely replicate the essence of being human, which is the foundation of storytelling. It just looked…fake, many <a href="https://www.deepdyve.com/lp/association-for-computing-machinery/the-reality-of-computer-graphics-in-the-motion-picture-industry-3SH8uQtBk4?articleList=%2Fsearch%3Fquery%3Dcomputer%2Bgraphics%2Bin%2Bhollywood">said</a>. At the time, CGI technology wasn’t advanced enough to mimic the motions of a real person, like the way your elbows and hips move in concert when you walk. Or the different shades of your skin because of the warm blood running behind your skin. There was a long way to go in creating a truly digital alternate world and very few visionaries were willing to keep taking risks to continue trailblazing CGI on the silver screen.</p><h3>‘George [Lucas] Doesn’t Know What He Has’</h3><p>In the early 80s, even the legendary director George Lucas wasn’t a full believer of CGI in his forthcoming Star Wars sequels. Alvay Ray Smith, the head of the newly built computer graphics branch of LucasFilm studio, <a href="https://design.osu.edu/carlson/history/PDFs/lucas-discovers.pdf">explains</a> how the Hollywood head honcho didn’t really have a clear vision for the potential of CGI. But, Lucas asked Smith to assemble a team of the best computer graphics visionaries of the time. Excited to be part of Lucas’ vision, Smith pulled in colleagues from the New York Tech, tech companies like Boeing, new grads from Cornell University and the Jet Propulsion laboratory. Curiously enough, Lucas didn’t ask them to work on CGI for his film. Instead, he gave them tasks that fulfilled not nearly half of their potential, like creating a digital film printer, audio synthesizer and controlled video editor.</p><blockquote>“There were no requests from Lucas to do what we were really good at,” <a href="https://design.osu.edu/carlson/history/PDFs/lucas-discovers.pdf">Smith says</a>. “By this time, it dawned on me that he did not understand raster graphics. George doesn’t know what he has. Although Lucas was clearly a visionary in digitalizing Hollywood, the best I can say about his computer graphics vision at that time was that he allowed me to assemble the best team of computer graphics wizards in the world.”</blockquote><p>But it makes sense. The best directors’ number one priority is to create an enthralling story that makes you forget about any fancy technology at play. Lucas paid close attention to direction, not novelty graphics, Smith explains.</p><p>LucasFilm might have never delved into CGI if it wasn’t for Paramount Pictures, which contracted the Industrial Light &amp; Magic (ILM) division of LucusFilm to create a digitized genesis scene in the upcoming film Star Trek II. At this time, ILM only worked with physical models, not CGI. Two lucky things helped propel a series of fortunate events that eventually led LucasFilm into the world of CGI. One, ILM just so happened to work in the building next to the LucasFilm’s computer department. Two, an ILM team member happened to be familiar with the computer folks next door.</p><p>And so the challenge was on. LucasFilm’s computer department would take on the contract work to create the genesis scene in StarTrek in which they bring a planet back to life.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/536/0*SQdu9Nk2lDpm7GEr.jpg" /></figure><p>But the <em>real</em> mission of the project was to, as Smith put it, “Knock george’s socks off.” The computer graphics team wanted to essentially create a “60-second long commercial to Lucas” by directing a move that Lucas would <em>know</em> could have only been created by a computer. Then, he’d fully realize what kind of talent he has at his disposal.</p><blockquote>We proceeded to design a move [building emotional force] based on the idea of a spacecraft flying by a dead, moon-like planet with a camera attached to the craft..It is a twisting, spiraling, accelerating, decelerating, sweeping, reversing, minute-long, continuous camera move.</blockquote><p>The plan worked. At the premier, Lucas was impressed and praised that particular camera shot and called on his computer graphics department to create 3D CGI in his next film, Return of the Jedi. You might say that Lucas was among the best Hollywood tech recruiters of all time! He built a team of some of the best CGI dreamers and stepped out of the way long enough for them to create something brilliant. Something he might have never imagined.</p><h3>Cultivating a Generation of Dreamers</h3><p>But it’d still be a couple more decades until CGI boomed as an independent industry. CGI grew in parallel to the widespread acceptance and popularity of personal computers, like the Apple computer. Still, Tron planted the seed for the next generation of dreamers to evolve what Lisberger started.</p><blockquote>“At a certain point in time, the gears really lined up with the original Tron. And it turns out they didn’t forget that. And after 28 years, those kids are now producers, and studio executives, and they were now 35 and 40, and in a position to make the film and take their own kids.”</blockquote><p>Forward-thinking programmers in Hollywood inspired a new generation of innovators through both the actual technology and the films. Today there are almost <a href="http://www.bls.gov/ooh/arts-and-design/multimedia-artists-and-animators.htm#tab-5">70,000</a> multimedia artists and animators creating CGI magic for film and TV in just the US alone. The majority of <a href="http://www.boxofficemojo.com/alltime/world/">top highest-grossing films since </a>the late 90’s have all been shot with computer-animated effects.</p><ul><li>Avatar (2009) — $2.8 billion</li><li>Titanic (1997) — $1.8 billion</li><li>Harry Potter and the Deathly Hallows, Part 2 (2011) — $1.3 billion</li><li>Jurassic Park (1993) $357 million</li><li>Terminator 2 (1991) $519.8 million</li></ul><p>Just think, without programmers, we might have never seen the ill-fated Titanic sink. We might have never stepped into the alternate universe of Avatar. Or we might have never met Wall-E, Gollum or Woody! In the words of Robert Abel, a pioneer in computer graphics: <em>“Technology just frees us to realize what we can imagine. It’s like being given the power to do magic.”</em></p><p><strong>Like this article? We’ll shoot you an email the next time we have a great post to share! Please sign up below.</strong></p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/how-programmers-freed-hollywood/"><em>blog.hackerrank.com</em></a><em> on June 29, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=85ccba553cde" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Big Data & the Risky Eclipse of Statisticians]]></title>
            <link>https://medium.com/@ritikatrikha/big-data-the-risky-eclipse-of-statisticians-8954f52b2900?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/8954f52b2900</guid>
            <category><![CDATA[big-data]]></category>
            <category><![CDATA[data-science]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:59:23 GMT</pubDate>
            <atom:updated>2015-09-20T18:59:23.377Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*ugaDC-NlM8XJDFB0.png" /></figure><p>If statisticians have historically been leaders of data, why was there a need for a brand new breed of data scientists? While the world is exploding with bounties of valuable data, statisticians are strangely working quietly in the shadows. Statistics <a href="http://www.amstat.org/">is</a> the science of learning from data, so why aren’t statisticians reigning as kings of today’s Big Data revolution?</p><p>In 2009, when Google was still fine tuning its PageRank algorithm based on the statistical innovation <a href="https://en.wikipedia.org/wiki/Markov_chain">Markov Chain</a>, Google’s Chief Economist Hal Varian declared statistician as the sexiest job of the decade. We’re about halfway through, and it seems that Varian missed the target.</p><blockquote>“Professional statisticians are milling at the back of the church, mesmerized by the gaudy spectacle of [Big Data] before them.” — <a href="https://www.deepdyve.com/lp/wiley/big-data-and-big-business-should-statisticians-join-in-6hkJJfoIma?articleList=%2Fsearch%3Fquery%3Dstatistician%2Band%2Bbig%2Bdata">David Walker</a>, statistician, Aug 2013.</blockquote><p>Google Trends shows us that while the popularity of Big Data is thriving, statisticians’ popularity has been declining over the years. Back in <a href="https://web.archive.org/web/20100418183033/http://kaggle.com/">2010</a>, predictive modeling and analytics website Kaggle proudly dangled Varian’s prediction as a carrot on their careers page to lure people to join their team. But today the quote curiously vanished–no longer deemed worthy.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/789/0*54u7FTM_o7NZ4tq0.png" /></figure><p>What speaks even louder volumes is that statisticians are often left out of some of the biggest national discussions happening around Big Data today. For instance, UC Berkeley’s Terry Speed <a href="http://flowingdata.com/2014/07/02/data-science-big-data-and-statistics-all-together-now/">observes</a>:</p><ul><li>US National Science Foundation invited 100 experts to talk about Big Data in 2012. Total number of statisticians present? 0.</li><li>The US Department of Health and Human Services has a 17-person Big Data committee. Total number of statisticians? You guessed it…0.</li></ul><p>Justin Strauss, co-founder at Storyhackers, who previously led data science programs in the healthcare industry, can attest to this more generally. He says he has “seen an underrepresentation” of statisticians at conferences and other events related to Big Data. But statistics is the foundation of understanding Big Data. This was supposed to be their decade–their time to shine in the limelight. So, what changed? As renowned statistician Gerry Hahn once said:</p><blockquote>“This is a Golden Age of statistics, but not necessarily for statisticians.”</blockquote><p>Instead of crowning statisticians king, the Big Data revolution borrowed the foundational elements of applied statistics, married it with computer science and birthed an entirely new heir: The Data Scientist. But this underrepresentation of statisticians puts the future of Big Data at risk. The accurate evaluation of data that comes from a strong foundation of statistics could be lost in the hype.</p><h4>Why Didn’t Statisticians Own Big Data?</h4><p>Plenty has been written about the recent rise of data scientists, but the application of data science to the industry is ancient. In the 1900s, statistician William Gosset studied yeast for the Guinness Brewing Company and invented the <a href="http://blogs.sas.com/content/jmp/2013/10/07/celebrating-statisticians-william-sealy-gosset-a-k-a-student/"><em>t</em>-distribution</a> in the process. Statistician Kaiser Fung <a href="https://www.deepdyve.com/lp/wiley/big-data-and-big-business-should-statisticians-join-in-6hkJJfoIma?articleList=%2Fsearch%3Fquery%3Dstatistician%2Band%2Bbig%2Bdata">points out</a> that one of the most notable examples of a business built upon statistical algorithms came decades before Google. Fair Isaac Company introduced the analytics of credit scoring in the <a href="http://www.fico.com/en/about-us#at_glance">1950s</a>. Not to mention the US government has been performing census calculations with incredible precision for hundreds of years as well.</p><p>There are three plausible reasons why statisticians aren’t leading Big Data today. First, computational statistics of Big Data never flourished in mainstream statistical sciences.</p><blockquote>“The area of massive datasets, though currently of great interest to Computational statisticians and to many data analysts, <strong>has not yet</strong> become part of mainstream statistical science.” — Buja A. Keller-McNulty</blockquote><p>This quote was published in 1999. And, a decade later, it never happened. Although early statisticians recognized and discussed Big Data, many of them were ignored. Speed points out that statisticians have published books and papers about the techniques of wrangling large datasets. But they collected dust, evident by the number of citations earned. For instance:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/823/0*4gwevZflTeB52Tyl.png" /></figure><p>Second, statistics is a crucial part of data science, but it–alone–is insufficient in making sense of exponential amounts of messy data we are producing daily. It requires computational power that can only be charged by the advanced technology we have today. In 2010, the world stored about 6 exabytes of data, a stat so incomprehensible that it’s borderline meaningless. For a frame of reference, if you converted <a href="http://www.jamesshuggins.com/h/tek1/how-big.htm">all</a> words ever spoken by humans into text, that’s about 5 exabytes! Here are some more quick Big Data stats:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*s5zW-VmmR6zkcgcD.png" /></figure><p>Machine learning is deeply rooted in statistics, but few statisticians have the technical skills to manipulate a dataset of 10 billion in which each data point has a dimension of 10,000. But it’s not that statisticians lack computational knowledge. It’s that the field of statistics simply wasn’t equipped with the computing power we have today. For instance, data scientist David Hardtke lead the invention of the Bright Score, an algorithm that assesses your fit for a job, which was acquired by LinkedIn. But he says none of these ideas are really <em>new</em>. Back when he first started in the space, he met a senior researcher at Recruit Holdings, a japanese recruiting firm.</p><blockquote>“He told me he’s really interested in what I’m doing because he tried to do the same thing in the 80s. He said, frankly, it was way too expensive back then. You had to buy these massive computers and it wasn’t cost effective,” Hardtke says.</blockquote><p>But now, we’re at this convergence of super cheap, high-speed computing that’s helping data scientists process powerful insights and find answers to questions that remained a mystery 20 years ago. With Big Data booming, pure statistics is fading into the background relative to the demand of data science.</p><p>Third, some statisticians simply have no interest in carrying out scientific methods for business-oriented data science. If you look at online discussions, pure statisticians often scoff at the hype surrounding the rise of data scientists in the industry. Some say it’s a buzzword with good marketing (<a href="http://www.slideshare.net/kuonen/a-statisticians-view-on-big-data-and-data-science">here</a>), other say it’s a made up title (<a href="https://modelviewculture.com/pieces/data-scientists">here</a>) and some call them folks who sold out to shareholders (<a href="https://www.deepdyve.com/lp/wiley/big-data-and-big-business-should-statisticians-join-in-6hkJJfoIma?articleList=%2Fsearch%3Fquery%3Dstatistician%2Band%2Bbig%2Bdata">here</a>).</p><h4>Statisticians’ Absence Could Lead to Misuse of Data</h4><p>Even without a prominent presence of statisticians, educational institutions are churning out entirely new curriculums devoted to the so-called “new” field of data science in just the last few years. But when dealing with Big Data, someone on the team needs to have a strong grasp of statistics to avoid reaching inaccurate conclusions.</p><p>The elevated hype about data scientists is undeniable. The WSJ reports that these jobs are so in-demand that data scientists with two years of experience are earning between $200,000 and $300,000 annually. It was dubbed the sexiest job of the 21st century in 2012. Universities are having to <a href="http://www.nytimes.com/2013/04/14/education/edlife/universities-offer-courses-in-a-hot-new-field-data-science.html?_r=0">turn</a> down data science students because of the outpour in popularity. As a result, there are at least a dozen new data science bootcamps that aim to prepare graduates for data science jobs. And universities across the nation are creating brand new courses and programs for data science or business analytics. Here’s a visualization thanks to <a href="https://columbiadatascience.files.wordpress.com/2012/12/a9uuetycyaiexqn-jpglarge.jpeg">Columbia Data Science</a>:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*MYW6HZbGy2XT40bN.jpeg" /></figure><p>But, as with any new curriculum, <a href="http://blog.hackerrank.com/why-many-computer-science-programs-are-stagnating/">space is limited</a>. This is where it gets risky. Ben Reddy, PhD in Statistics, at Columbia University <a href="http://columbiadatascience.com/2012/12/03/in-defense-of-statistics-or-why-data-scientists-should-make-understanding-statistics-a-priority/">finds</a> that the foundation of statistics often takes a backseat to learning the technical tools of the trade in data science classes. And even if students are carrying out statistical models in classes, doing statistics doesn’t guarantee that you understand statistics. Since learning R or NumPy is usually the gateway to getting your hands on real-world data, understanding statistical analysis is often less interesting comparatively.</p><blockquote>“Anyone who can type &lt;t.test(data)&gt; into R (not to mention &lt;lm()&gt;, &lt;knn()&gt;, &lt;gbm()&gt;, etc.) can “do” statistics, even if they misuse those methods in ways that <a href="http://en.wikipedia.org/wiki/William_Sealy_Gosset">William Sealy Gosset</a> wouldn’t approve on his booziest days at the Guinness brewery.” Reddy writes.</blockquote><p>The worst part is, you can usually get away with carrying out subpar analysis because it’s hard to identify the quality of statistics without examining analysis in detail, he adds. And, usually, there’s not enough transparency to do this in the real-world. So, with the absence of statisticians in Big Data today, how well are the fundamentals of statistics carried over in this new data science boom? Most students haven’t even graduated from these brand new data science courses yet, so it remains to be seen.</p><p>But this risk in losing the fundamentals is largely why Hardtke, a physicist himself, is opposed to these new degree programs. He makes a compelling point: It’s better to have someone who’s really passionate about geology, physics or any other science because they’ll pick up the tools of data manipulation as part of a bigger mission.</p><blockquote>“I’d rather have someone major to get some answer and learn the tools along the way rather than learn the tools as the terminal point,” Hardtke says.</blockquote><h4>But the Most Powerful Data Science Teams are Multidimensional</h4><p>Folks outside of the space often don’t realize that the most astonishing achievements in data science weren’t accomplished by just one superstar, unicorn data scientist. When Hardtke was tasked with building a strong data science team at startup Bright.com several years ago, he couldn’t afford to recruit the best data scientist away from the likes of Google and Facebook. But he knew something most data scientist-crazed recruiters don’t understand: At its core, it’s all about learning how to ingest data using statistical methodology and computational techniques to find an answer.</p><p>Most scientific disciplines require this knowledge. So, he hired scientists across disciplines: physicist, mechanical engineer, statistician, astrophysicist–basically anyone who wasn’t a computer scientist or data scientist. The most successful, passionate data science teams in Silicon Valley comprise of a combination of different scientific disciplines that look at one problem from unique angles. It’s the only way to work through seemingly impossible problems in data science.</p><p>If you ask <a href="https://www.linkedin.com/in/nitinsharmaus">Nitin Sharma</a>, for instance, about his data science team at the early days of Google, his eyes instantly light up. With experts from psychology, computer science, statistics and several other disciplines, Sharma’s diverse team offered perspectives from every dimension possible. Google’s head of search Amit Singhal once asked him: “How do you know if people are happy with the search results?” Tracking the simple act of clicks on links can’t determine whether or not the searcher was happy with his result. And so, the challenge was on for Sharma’s team.</p><blockquote>“I can’t tell you the details of what Google did, but conceptually, we looked at what sequence do these clicks have? How much time they’re spending? How often do they refine queries? How often do they click on results? How many results? How does it depend on the type of query?” Sharma says.</blockquote><p>And, ultimately, Sharma’s team was able to work together to find a successful plan to monitor a user’s happiness, which offered deeper insight into search behavior and satisfaction with search results. While both data science and statistics share a common goal of extracting meaningful insight from data, the evolution of data science in the last 10 years emphasizes a demand for a combination of interdisciplinary skill.</p><p>Data science is making statistics–alone–irrelevant in industry. Hence, eclipsing statisticians, or fathers of data science.</p><p>On a scale of 1–10, Sharma says we’ve only inched maybe 1–2 in terms of progress in data science. With the forthcoming revolution of the Internet of Things, there’s infinite possibilities before us. The biggest challenge will be: How do we process and understand this unsurmountable data? The onus can’t be on “rockstar, unicorn” data scientists alone. And it can’t fall onto statisticians either. Although the demand for pure statistics will shrink relative to data science and over time, it’s going to be more important than ever to have interdisciplinary knowledge from a variety of fields. And to ensure quality and foundational understanding of applied statistics, it’s crucial to save a seat for statisticians at the Big Data table.</p><p><strong><em>Have you noticed an underrepresentation of statisticians in Big Data? Tell us what you think in the comments below!</em></strong></p><p><em>To get occasional notifications when we write blog posts, please </em><a href="http://eepurl.com/bozyBf"><strong><em>sign up for our email list</em></strong><em>.</em></a></p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/the-risky-eclipse-of-statisticians/"><em>blog.hackerrank.com</em></a><em> on July 20, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=8954f52b2900" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Innovation Has Always Crushed Poverty]]></title>
            <link>https://medium.com/@ritikatrikha/innovation-has-always-crushed-poverty-7ed68c58e3c0?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/7ed68c58e3c0</guid>
            <category><![CDATA[entrepreneurship]]></category>
            <category><![CDATA[technology]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:58:29 GMT</pubDate>
            <atom:updated>2015-09-20T18:58:29.796Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*O3oj8vggLvAXn7gC.png" /></figure><p>For the first 10,000 years of human history, the world was very still, confined by hand-crafted tools, acres of farmland and not much else. When the 18th century rolled around, suddenly there was exponential progress. Everything changed.</p><p>The Industrial Revolution introduced the definition of “innovation” as we know it today. It marked an era when inventions upon inventions proliferated society, boosting productivity through the automation of labor. The quaint English town of <a href="http://www.bbc.co.uk/birmingham/content/articles/2008/04/15/birmingham_facts_feature.shtml">Birmingham</a> was history’s original Silicon Valley, a fertile destination of the forward-thinking minds who created technologies that shook the rest of the developed world.</p><p>With each new tech-driven idea unleashed in the market, the progress bar for societal and economical prosperity shot up higher and higher. Income <a href="http://fee.org/freeman/detail/the-industrial-revolution-working-class-poverty-or-prosperity">skyrocketed</a>. Families had more <a href="http://www.bbc.com/news/magazine-20243692">food</a> on the table. People <a href="http://fee.org/freeman/detail/the-industrial-revolution-working-class-poverty-or-prosperity">lived</a> longer. A middle class blossomed as folks below the poverty line capitalized on new, attainable job opportunities. But it wasn’t just a period of ground-breaking inventions that made this era significant–it was the longevity of impact still felt today.</p><p>In just the last 20 years, the rise of the software technology revolution produced a spurt of innovations with an economic impact similar to that of the 1760s. With each year that passes by, the speed and capacity has been exponentially increasing, while the cost of software and hardware has been plummeting. Thanks to the parallel <a href="http://www.washingtontimes.com/news/2014/oct/6/economic-globalization-boosts-asia-bogs-down-us-mi/?page=all">expansion</a> of world trade, today we’re witnessing another pivotal moment of human history. Developing worlds that were once frozen in the agricultural bubble are starting to burst into the 21st century. Rural dwellers in China, India and other eastern developing nations are moving to urban factories.</p><p>Just as innovation empowered the lowest social class with the opportunities to rise up, technological innovation will continue to pull poverty-stricken people out of the slums worldwide. This <a href="http://ourworldindata.org/data/growth-and-distribution-of-prosperity/world-poverty/">visualization</a> by economist Max Roser reveals a fascinating, optimistic outlook on the future end of poverty. Even though our population has been exponentially increasing, for the first time ever, the absolute number of people in poverty is lower than ever before. In order to truly understand why absolute poverty started to deteriorate, we must go back to the eve of the Industrial Revolution.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/981/0*aZHAqbuOnMMtCg-0.png" /></figure><h4>When Innovation Gathered Steam: The Rise of Social Mobility</h4><p>Many historians have dedicated their lives to figuring out why there was a sudden burst of significant inventions and desire for entrepreneurship particularly in the 1700s. Why then? Why there? Over <a href="http://atibook.ir/dl/en/Others/Non-Fiction/9781400067053_the_most_powerful_idea_in_the_world.pdf">200</a> theories are circulating. But one fascinating explanation involves a shift in human character and thinking. Historian William Rosen <a href="http://atibook.ir/dl/en/Others/Non-Fiction/9781400067053_the_most_powerful_idea_in_the_world.pdf">posits</a>:</p><blockquote>In England, a unique combination of law and circumstance gave artisans the incentive to invent, and in return obliged them to share the knowledge of their inventions.</blockquote><p>In other words, it was the first time that ideas were considered property–a source of profit. Until this point in time, Europeans had been drenched in religious domination, suffering from Metathesiophobia<strong>, </strong>or fear of change. But following the era of Enlightenment, commercialization of new ideas was a possibility. So a diverse body of visionary industrialists, from educated scientists to uneducated merchants, set out to improve their way of life–profiting along the way. At this point, Britain was the <a href="https://eh.net/encyclopedia/an-economic-history-of-patent-institutions/">only</a> place in the world that developed a patent system.</p><blockquote>It was not until the 17th century that patents were associated entirely with awards to inventors…. The Statute of Monopolies allowed patent rights of fourteen years for “the sole making or working of any manner of new manufacture within this realm to the first and true inventor…”</blockquote><p>The 1700s England Industrial Revolution was the earliest form of the technological innovation that’s booming today. Not only were people empowered to become inventors but–for the first time–humans weren’t pegged into only two classes: “poor” or “elite.” Anyone had the opportunity to not only profit from their idea but also learn an in-demand operational skill that spawned from new product technologies. One such revolutionary job-generating technology was the steam engine, which <a href="http://atibook.ir/dl/en/Others/Non-Fiction/9781400067053_the_most_powerful_idea_in_the_world.pdf">scholars</a> point to as the symbol of the Industrial Revolution.</p><blockquote>“Thousands of innovations were necessary to create steam power, and thousands more were utterly dependent upon it, from textile factories — soon enough, even the water frame was steam-driven — to oceangoing ships to railroads<em>,”</em> — <a href="https://books.google.com/books?id=4wycmAWSWSMC&amp;pg=PR22&amp;lpg=PR22&amp;dq=Thousands+of+innovations+were+necessary+to+create+steam+power,+and+thousands+more+were+utterly+dependent+upon+it,+from+textile+factories%E2%80%94soon+enough,+even+the+water+frame+was+steam-driven%E2%80%94to+oceangoing+ships+to+railroads.&amp;source=bl&amp;ots=aURSd7SprK&amp;sig=0BggDIvN8bfL7DburSsbgM1l7Ms&amp;hl=en&amp;sa=X&amp;ved=0CB8Q6AEwAGoVChMI-biGzryKxwIV0nySCh2XIw3f">Rosen</a></blockquote><p>The steam engine was the nucleus of innovation in Birmingham that spawned the Industrial Revolution. It was much like the way transistors spawned the Information Age in Silicon Valley. The mobility of steam as an energy source freed people from the chains of agrarian society. Factories could be built anywhere, spawning urbanization and opportunities for wealth. It helped develop a substantial middle class–a first for humankind.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/493/0*m14dZuWWnyAutp5A.png" /></figure><h4>How Global Poverty Halved Since the ‘90s</h4><p>Fast-forward to present day–even though the population has increased 7X — poverty is at an all time low, and rapidly falling. Between 1990 and 2010, absolute poverty fell from 43% to 21%–just about half. Poverty’s at an all time low even though population has increased.</p><p>So what extinguishes the flames of poverty? History tells us that a boom in economic growth and employment opportunities will produce a long-term negative impact on poverty. The Organization for Economic Co-operation and Development <a href="http://www.oecd.org/dac/povertyreduction/43280288.pdf">confirms</a> that the rate of poverty decline is directly correlated with increase in economic prosperity in any given region.</p><blockquote><a href="http://www.oecd.org/derec/unitedkingdom/40700982.pdf">For example</a>, a flagship study of 14 countries in the 1990s found that over the course of the decade, poverty fell in the 11 countries that experienced significant growth and rose in the three countries with low or stagnant growth.</blockquote><p>Since the 1990s to 2010, the developing countries’ GDP has been increasing by <a href="http://www.economist.com/news/briefing/21578643-world-has-astonishing-chance-take-billion-people-out-extreme-poverty-2030-not">6%</a>, as depicted here:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/640/0*SAuTGWwnw_9sovmK.png" /></figure><p>Although there are quite a number of factors at play for the rise in economic size, optimizing productivity through smarter software tech plays a crucial role in bolstering developing economies. Africa is a prime example of how technology is helping its economy grow. In the last decade, African countries boasts a fast-growing startup market. Mobile phones have been one prolific economic growth engine, reducing the cost of communication, fueling productivity and opening up access to capital</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/582/0*yWlF46W1sZCNQVv-.png" /></figure><p>One analysis of <a href="http://www.gsma.com/publicpolicy/wp-content/uploads/2012/11/gsma-deloitte-impact-mobile-telephony-economic-growth.pdf">96</a> different countries found that a 10% increase in mobile phone penetration can increase GDP growth by 1.2%!</p><p>So, on one end you have widespread use of mobile technologies in one of the most underdeveloped continents on the planet. The other side of the innovation loop: Mobile adoption was directly associated with a boost in the country’s economy. Above all, these studies show that economic prosperity, spawned by innovation, helps flatten poverty. This is just one example of an underdeveloped region benefiting from technological economic engine.</p><h4>Emerging Worlds are Now Leapfrogging the Industrial Revolution</h4><p>As a result of the large-scale tech adoption in developing countries, these folks are emerging out of their agrarian bubble to–not only catch up with the Industrial Revolution–but in some cases jump right into the digital age. Not only are some Africans skipping traditional institutions (like adopting virtual money instead of building banks) but Africa’s also turning into a hub of mind-blowing innovations. For example:</p><ul><li><a href="http://www.afrigadget.com/">The BetaBook</a> — A simple whiteboard that connects with a smartphone to help ease communication by instant translation with non-native speakers.</li><li><a href="http://www.csmonitor.com/World/Africa/2011/1111/iCow-Kenyans-now-manage-their-herds-via-mobile-phone">The iCOW App</a> — As high-growth as Africa is, it’s still largely dependent on agriculture. But this app helps African farmers manage their cows. The app keeps track of the estrus stages of their cows, while giving them valuable tips on cow breeding and more.</li><li><a href="http://www.forbes.com/sites/mfonobongnsehe/2012/02/09/young-african-invents-touch-screen-medical-tablet/">The CardioPad</a> — A young African engineer created a medical health tablet that performs heart examinations remotely in rural areas, helping save thousands of lives.</li><li><a href="http://www.buylifestraw.com/en/">LifeStraw</a> — It’s a portable water filter that claims to remove a minimum of 99.9% of waterborne diseases through instant filtration.</li></ul><p>From its very first appearance as the propagator of the Industrial Revolution, innovation has always been an indirect suppressor of poverty. The motivation of turning profit from something that actually benefits the masses proves to be highly impactful. Innovation benefits both the inventor and the consuming market over time by creating more opportunities for economic growth.</p><p>When you zoom out and take a look at human history as a whole, you can see that greed isn’t always evil. When incentivized to profit from ideas, humankind began changing the world for the better. True innovation is a result of harmonious collaboration between those who engineer an idea and those who can actually implement it.</p><p>The biggest inhibitors of progress thus far have been governmental policies, which is largely why the developing world has been slow to adopt new technologies. But in the last few decades, we’ve seen immense progress that makes us feel optimistic about a future without poverty. Underdeveloped nations who were ridden with government regulations and policies, are now benefiting from open channels of commerce. With the rise of globalization, tech companies can continue to help make the world flatter by innovating on both sides of the globe while profiting along the way.</p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/when-greed-is-good-innovation-has-always-crushed-poverty/"><em>blog.hackerrank.com</em></a><em> on August 5, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7ed68c58e3c0" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Unhealthy Obsession with Tree Questions]]></title>
            <link>https://medium.com/@ritikatrikha/the-unhealthy-obsession-with-tree-questions-6f4af96081cb?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/6f4af96081cb</guid>
            <category><![CDATA[coding]]></category>
            <category><![CDATA[recruiting]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:57:31 GMT</pubDate>
            <atom:updated>2015-09-20T18:57:31.590Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/759/0*z73C59wb-H3mEUq3.png" /></figure><p>Why do engineers love to ask fundamental linked list and tree questions in interviews when you rarely code these problems in real-world development?</p><p>It’s evolved into a rite of passage. Every engineering candidate, from fresh-faced grads to authors of crucial open source contributions, solves fundamental data structure problems on the spot for interview screenings.</p><p>It’s how it’s always been done. But it makes sense. This ritual has sustained itself over the past few decades because it’s a fast, reliable way to spot smart candidates who can think deeply. Plus, it’s better to hire for ability to solve timeless fundamental problems than hire for knowledge based on transient tools. Hence, each of the top 10 technology companies in the Fortune 500 have asked engineering candidates core computer science concepts, including tree or list-related programming questions within the last few years:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*WXgeMnUgubaAONni.png" /></figure><p>When front-end developer Stephanie Friend graduated from Cal Poly with an engineering and liberal arts hybrid degree, it had been a while since she sat in a lecture hall to learn about linked lists. It’s a good thing she blew the dust off her old data structure books and practiced challenges online before interviewing at one Silicon Valley startup in May this year:</p><blockquote>“I had an interview with 6 different engineers on the same team, and 5 out of 6 interviewers asked me to solve a different linked list problem for a web development position,” Friend says.</blockquote><p>So, why the need to ask 5 different linked list questions on 5 different occasions for 1 company? Some argue that you can’t be a great programmer unless you have these fundamentals down pat. Others say that CS fundamental knowledge is a good predictor of other useful programming knowledge.</p><p>It’s why most programming interview prep books, in even as early as the <a href="http://books.lihui.org/cs2/Wiley%20-%20Programming%20Interviews%20Exposed_Secrets%20to%20Landing%20Your%20Next%20Job%20%282000%29.pdf">2000s</a>, have chapters dedicated solely to basic data structure and algorithm problems (e.g. <a href="http://www.developer.com/mgmt/three-types-of-interview-questions-software-developers-should-expect.html">1</a>, <a href="http://steve-yegge.blogspot.ca/2008/03/get-that-job-at-google.html">2</a> and <a href="http://javarevisited.blogspot.com/2012/01/google-interview-questions-answers-top.html">3</a>). Plus, data structure and algorithm questions make up the bulk of upvoted questions on <a href="http://www.careercup.com/page?sort=votes">CareerCup</a>, a job prep community. You might be a little puzzled why we’re criticizing these questions, considering <a href="https://www.hackerrank.com/challenges/tree-preorder-traversal">tree</a> and <a href="https://www.hackerrank.com/domains/data-structures/linked-lists">linked lists</a> challenges are some of the most popular on our own HackerRank platform.</p><p>But there’s a big flaw with companies that aren’t preparing candidates sufficiently before an interview and then relying <em>solely</em> on academic CS fundamentals to weed out unqualified candidates. Data structure and algorithm fundamentals are just one part of what makes a great engineer. Depending on the need, managers should also look at other crucial components, like technical experience, hard-to-acquire knowledge, design and debugging skills to comprehensively assess a candidate.</p><p>While fundamentals are crucial, using data structure questions as the be-all end-all filter for great programmers can be detrimental for talented engineers who don’t have CS degrees or who earned their CS degrees several years ago. By placing a heavy emphasis on fundamental knowledge–<em>without properly preparing candidates</em>–companies can create a bias toward recent CS graduates. As a solution, interviewers need to empower candidates with preparation material to reduce the number of great programmers who are rejected.</p><h4>The Real World vs. Programming Interviews</h4><p>A typical programmer, even at a top tech company, would rarely implement a data structure like a binary tree from scratch. So, many devs might be out of practice with this by their next interview. The most famous recent example is Max Howell, the author of HomeBrew, a celebrated program management system for Macs. This year, Howell applied for an engineering position at Google and was rejected because, as he claims, he couldn’t “invert a binary tree” during the initial interview.</p><p><em>Google: 90% of our engineers use the software you wrote (Homebrew), but you can’t invert a binary tree on a whiteboard so fuck off.</em></p><p><em>— Max Howell (@mxcl) </em><a href="https://twitter.com/mxcl/status/608682016205344768"><em>June 10, 2015</em></a></p><p>While we can’t definitively say why Howell didn’t get the job (it could have been a number of factors that interviewers don’t reveal), it’s likely that he could have performed better if he had known to brush up on those fundamentals by practicing online. After all, he’s an extremely accomplished and smart engineer. So, there’s a chance he was a classic false negative candidate.</p><p>The obsession that top tech companies have with data structure problems can also be unfair to engineers who never sat in a CS class a day in their lives. If you don’t have a CS degree, it can be difficult to gauge how much you need to know to clear the initial bar during interviews.</p><blockquote><em>“While these questions can help select talented developers, they become highly problematic when somebody doesn’t have proper tools to prepare and doesn’t understand what is expected. A candidate might feel they need to read an entire algorithms book, which wastes their time and results in less time actually practicing problems.” says Gayle Laakmann McDowell, tech hiring consultant and author of Cracking the Coding Interview.</em></blockquote><p>Although many great candidates get rejected because they failed to adequately prepare, it’s actually not that hard for smart developers to learn or re-learn the fundamentals. It’s part of why companies are fine with requiring them. Today there are a host of online resources to help you practice data structure questions. McDowell, who’s passionate about teaching programming, once successfully taught a student the required basics in just <em>2 hours</em>. Another one of McDowell’s students was a self-taught programmer with a degree in music and learned and practiced enough of the fundamentals to land a job at Facebook.</p><p>But not everyone’s fortunate enough to have McDowell coach them individually. Self-taught students and experienced programmers are left to fend for themselves, leaving many of them annoyed and confused about the purpose of such fundamentals at dream company interviews, like Google and Apple (<strong>complaints evident </strong><a href="https://news.ycombinator.com/item?id=9703660"><strong>here</strong></a><strong>, </strong><a href="http://programmers.stackexchange.com/questions/102041/why-are-data-structures-so-important-in-interviews"><strong>here</strong></a><strong> and </strong><a href="http://www.quora.com/What-does-it-mean-if-a-future-programmer-sucks-or-hates-learning-algorithms-and-data-structures"><strong>here</strong></a>).</p><p>The best companies also test for other important factors that make a great engineer. For instance, discussing a technical project that a candidate is proud of can reveal knowledge, passion and ability to communicate well. Again, fundamentals can be very easy to learn if you know how much to prepare.</p><h4>The Root of the Obsession</h4><p>Since the initial boom in software engineering back in the 1980s, data structure and algorithm questions have been the common way to test candidates. The earliest engineers with growing teams carried CS degrees, and they knew that algorithm classes were a great place that required deep thinking. So, engineers of the 80s created this interview process that resembles algorithm classes. And it works accurately enough. When searching for talent, these questions are fast enough to answer in less than an hour and help interviewers gauge a programmer’s intelligence. It’s certainly not the only way to filter candidates for smartness, but–again–it works well enough.</p><p>McDowell theorizes that there might be another reason why companies expect knowledge of data structures like linked lists and trees: It’s hard to find enough algorithm questions that don’t involve these.</p><blockquote><em>“Companies test algorithmic problem solving skills because they believe that people who are smart will generally do good work; they’ll find good solutions, write good code, and so on. I suspect companies continue to expect knowledge of data structures like linked lists and trees (which developers rarely directly use) because it’s hard to find enough algorithm problems that don’t cover this knowledge. And, since enough people have CS degrees, and it’s easy enough for those who don’t to learn this material, it creates a pattern where it’s okay to expect that knowledge,” McDowell says.</em></blockquote><p>Companies deem this system effective because successfully answering algorithm questions are a positive indicator of success on the job. As McDowell says, it means they’re smart and they’re likely to do better work.</p><p>However, companies that don’t prepare candidates well enough aren’t giving them a chance to perform well at these fundamental questions. Most companies recognize that some good candidates will be rejected through these questions, but they’re okay with the drawback of missing out on good candidates. They figure, it’s better to reject a good candidate than hire a bad one. The veteran engineer Joel Spolsky, and author of the Trello software, once <a href="https://books.google.com/books?id=xdxrDYZyNLUC&amp;pg=PA156&amp;lpg=PA156&amp;dq=It+is+much,+much+better+to+reject+a+good+candidate+than+to+accept+a+bad+candidate.+A+bad+candidate+will+cost+a+lot+of+money+and+effort+and+waste+other+people%E2%80%99s+time+fixing+all+their+bugs.+Firing+someone+you+hired+by+mistake+can+take+months+and+be+nightmarishly+difficult,+especially+if+they+decide+to+be+litigious+about+it.+In+some+situations+it+may+be+completely+impossible+to+fire+anyone.+Bad+employees+demoralize+the+good+employees.&amp;source=bl&amp;ots=KhtC9BMeXF&amp;sig=ZEdfV9fUcChvk7FUXgBOu5PC0H8&amp;hl=en&amp;sa=X&amp;ved=0CB8Q6AEwAGoVChMIkMb1r7-fxwIVkzaICh3LFwfP#v=onepage&amp;q=It%20is%20much%2C%20much%20better%20to%20reject%20a%20good%20candidate%20than%20to%20accept%20a%20bad%20candidate.%20A%20bad%20candidate%20will%20cost%20a%20lot%20of%20money%20and%20effort%20and%20waste%20other%20people%E2%80%99s%20time%20fixing%20all%20their%20bugs.%20Firing%20someone%20you%20hired%20by%20mistake%20can%20take%20months%20and%20be%20nightmarishly%20difficult%2C%20especially%20if%20they%20decide%20to%20be%20litigious%20about%20it.%20In%20some%20situations%20it%20may%20be%20completely%20impossible%20to%20fire%20anyone.%20Bad%20employees%20demoralize%20the%20good%20employees.&amp;f=false"><strong>penned</strong></a> this common hiring philosophy in detail back in 2004:</p><blockquote><em>“It is much, much better to reject a good candidate than to accept a bad candidate. A bad candidate will cost a lot of money and effort and waste other people’s time fixing all their bugs. Firing someone you hired by mistake can take months and be nightmarishly difficult, especially if they decide to be litigious about it. In some situations it may be completely impossible to fire anyone. Bad employees demoralize the good employees,” Spolsky says.</em></blockquote><p>There might be some validity in the cost per bad hire in Spolsky’s outlook, but rejecting too many good candidates will dramatically increase the cost and time to hire — and ultimately, restrict company growth. All companies should be concerned with this.</p><h4>Interview Prep is Not ‘Cheating’ and Necessary to Fill Empty Positions</h4><p>About 10 years ago or so, companies were somewhat more wary about giving candidates preparation material before an interview. It was sometimes considered taboo or even “cheating” because they worried candidates might memorize problems and regurgitate knowledge in the interview.</p><p>But that mindset has slowly started to shift as the shortage of talented developers has intensified. In a <a href="http://blog.hackerrank.com/the-unhealthy-obsession-with-tree-questions/In%20a%202013%20survey">2013 survey</a> of over 1,500 senior IT and business executives, more than a third identified availability of talent, employee turnover and labor prices as a business concern.</p><blockquote>“Jobs postings will be listed for months without finding a good candidate,” former Zynga software engineer and founder of Appurify, Rahul Jain told TechCrunch.</blockquote><p>Given these concerns, it’s actually in a company’s best interest to help candidates with interview prep by giving candidates a chance to practice solving CS fundamental problems. It’s simple: Better prepared candidates lead to fewer false negatives. Plus, most engineers can easily distinguish between someone who’s just memorized answers and someone who can truly solve a hard problem.</p><p>The best tech companies realize that it’s actually beneficial to both engineers and companies to give candidates a fair opportunity to put their best foot forward. This is especially true given the obsession with fundamentals that most engineers don’t usually revisit since the good old college days. It’s also a good way to skip the anxiety-ridden phase of the interview and get to other meatier questions that are just as important in assessing candidates, like culture fit and collaborative skills.</p><p>Googler Steve Yegge is one engineer who realized candidate preparation is an effective solution to the talent shortage early on. Back in 2008, he “secretly” <a href="http://blog.hackerrank.com/the-unhealthy-obsession-with-tree-questions/blogged">blogged</a> engineering interview tips for Google candidates in hopes that more of his interviewees would succeed:</p><blockquote>Time passes, and interview candidates come and go, and we always wind up saying: ‘Gosh, we sure wish that obviously smart person had prepared a little better for his or her interviews. Is there any way we can help future candidates out with some tips?’</blockquote><blockquote>Google doesn’t know I’m publishing these tips. It’s just between you and me, OK? Don’t tell them I prepped you. Just go kick ass on your interviews and we’ll be square….</blockquote><p>As late as 2008, people were so against offering candidate prep that Yegge even considered publishing his tips under a pseudonym to avoid upsetting people. Ultimately, his desire and need for better prepared candidates outweighed the risk of earning negative sentiments. This is also a huge reason why McDowell also left Google to start her empire of interview prep about seven years ago. As a software engineer at Apple, Google and Microsoft, McDowell interviewed one too many ill-prepared but smart candidates. She wanted to teach and help more engineers become better interviewers; thus, CareerCup was born.</p><p>The best tech companies are starting to realize that the more preparation, the better interview-to-hire rate. For instance, today Facebook hires McDowell for a weekly 1.5 hour class for candidates exclusively for interview prep. She walks Facebook candidates through the problems and even offers tips along the way. Facebook found so much success in this recruiting strategy that they doubled the frequency of her class. Today select top-tiered tech companies, like Pinterest, Google, Airbnb and Twitter, send at least an email that points candidates to resources for better preparation and practice for fundamental CS challenges.</p><p>More companies should look at why they’re rejecting great candidates and how they can reduce false negatives to help grow their team more successfully. Empowering smart candidates by setting more realistic expectations for candidates about the interview process is one way to accomplish this.</p><p>This decades-old process of testing engineers’ intelligence through fundamental CS questions may be sufficient to identify great programmers. But this process should come with a mechanism (at the minimum an email with links to resources) to help candidates practice these fundamental challenges for the interview. By helping candidates prepare, companies can more easily identify great developers and reduce the bias against older and nontraditional candidates. They can also focus on other important components that are crucial in evaluating strong engineers. This ultimately reduces hiring costs and fuels company growth — a win for the company and the candidate.</p><p><strong><em>Do you prep your candidates before quizzing them on trees and linked list questions?</em></strong></p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/the-unhealthy-obsession-with-tree-questions/"><em>blog.hackerrank.com</em></a><em> on August 12, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=6f4af96081cb" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[How Amazon Web Services Surged Out of Nowhere]]></title>
            <link>https://medium.com/@ritikatrikha/how-amazon-web-services-surged-out-of-nowhere-dcde19739147?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/dcde19739147</guid>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:55:59 GMT</pubDate>
            <atom:updated>2015-09-20T18:55:59.282Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/739/0*OHMFEpXFgHxO_lNE.png" /></figure><p>Few people–if any–saw it coming. Even engineers who helped build the omnipresent Cloud that is Amazon Web Services (AWS) are surprised by its goliath success today.</p><blockquote><em>“You never know how big something will be while you’re working on it, Christopher Brown,” an early AWS engineer </em><a href="http://www.businessinsider.com/amazons-game-changing-cloud-was-built-by-some-guys-in-south-africa-2012-3#ixzz3jk6a6ufC">told</a> Business Insider.</blockquote><p><strong>When Amazon CEO Jeff Bezos first proposed selling infrastructure-as-a-service (IaaS), his board of directors raised an eyebrow. It’s understandable. For the general population, “Cloud-based technology platform” isn’t exactly the first thing that comes to mind when you think of Amazon. AWS is far removed from the core function as an e-commerce site going 21-years-strong. But today AWS zooms so far ahead in the market that its competitors are dwarfed into tiny specs in its rear view mirror. Even its own execs behind its growth strategy say they’re </strong><a href="http://www.washingtonpost.com/business/on-it/the-rise-of-amazon-web-services/2015/04/23/fe1b3980-e795-11e4-9a6a-c1ab95a0600b_story.html"><strong>surprised</strong></a><strong> at the speed of AWS’s claim to fame. Here’s a matrix depiction of the market share by </strong><a href="https://aws.amazon.com/resources/gartner-storage-mq-2014-learn-more/"><strong>Gartner</strong></a><strong>:</strong></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*jORQz9vr2XeLhO85.png" /></figure><p>For several years, AWS has been a developer’s paradise, a platform where you can build and run software without having to set up your own servers. It’s grown to be so huge that even its IaaS competitors, like DigitalOcean, depend on it. Nearly <a href="http://www.trinimbus.com/uncategorized/go-all-in-on-amazon-web-services/">40%</a> of traffic runs through its infrastructure, according to an estimation by Jarrod Levitan, Chief Cloud Officer at TriNimbus. Another more concrete statistic by <a href="http://blog.deepfield.net/2012/04/18/how-big-is-amazons-cloud/#comments">Deepfield Networks</a> found that 1/3 of Internet users visit an AWS-supported website daily.</p><p>If AWS stopped working tomorrow, much of the Internet would dim. You wouldn’t be able to browse billion dollar social networking sites, like Pinterest. Your DropBox photos and files would be missing in action. You couldn’t stream Netflix. Forget scoring a great deal on Airbnb. Many of these billion dollar startup may have never disrupted their respective industries without AWS to propel them quickly on the scene. Plus, enterprises and even the ever-paranoid governmental agencies, like the CIA, NASA, Department of Defense and the Pentagon are now relying on AWS.</p><p>Not only is it massive, but its capabilities are astounding. Of the dozen services, arguably among the most innovative is Amazon Kinesis, a real-time processing service for live events and streaming. It can continuously capture and store terabytes of data each hour from hundreds of thousands of sources at once. It’s great, for instance, for helping advertising agencies make sense of live social chatter.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/930/0*s5otVtJwNMqzOQh-.jpg" /></figure><p>The team knew the initial concept was–at most–an interesting idea, but there are so many existing big players in the realm of data storage. How could Amazon, an online shopping site, compete? Having put his neck on the line in front of investors, Bezos must have known he was on to <em>something</em>…but no one could have predicted the scale to which AWS has escalated.</p><h4>The Canny Rise of ‘the Infrastructure of the World’</h4><p>There’s an old folklore about how AWS got its legs. The story goes that because Amazon’s technology capacity requirement naturally shoots off the charts during holiday season, it has excess capacity for the rest of the year. So, why not rent the excess storage to other companies that need it?</p><p>Amazon CTO Werner Vogels <a href="http://www.quora.com/How-and-why-did-Amazon-get-into-the-cloud-computing-business">wonders</a>: Why won’t this myth die?</p><blockquote>It was never a matter of selling excess capacity, actually within 2 months after launch AWS would have already burned through the excess <a href="http://amazon.com/">Amazon.com</a> capacity.</blockquote><p>One thing that the fable gets right is that AWS was created out of Amazon’s own need to support high volume of data. But each interface was created with design and intent that outsiders will eventually use it. Former Amazonian Steve Yegge <a href="https://plus.google.com/+RipRowan/posts/eVeouesvaVX">recalls</a> the infamous mandate put forth by Bezos around 2002:</p><blockquote>“He issued a mandate that was so out there, so huge and eye-bulgingly ponderous, that it made all of his other mandates look like unsolicited peer bonuses.”</blockquote><p>Essentially, the mandate not only required all developers to expose data through surface interfaces over network but also built to be “externalizable,” or good enough for outsiders to use. So, you see, it was always about deliberate business and innovation from its inception, stemmed by Bezos’ singular focus on obsessively serving their customers. Amazon had been perfecting its infrastructure to meet massive needs for several years. Given its internal success. it only made sense for Bezos to take his team’s invaluable skill and profit from it.</p><p>But AWS wasn’t Bezos’ brainchild.</p><p>The initial proposal paper (because <a href="http://www.philanthropydaily.com/jeff-bezos-powerpoint-prohibition/">Bezos doesn’t like slides</a>) <a href="http://blog.b3k.us/2009/01/25/ec2-origins.html">came from</a> head of global infrastructure Chris Pinkham, who first ideated a potential “Infrastructure of the World.”</p><p>He worked closely with website engineering manager Benjamin Black:</p><blockquote>Chris was always pushing me to change the infrastructure, especially driving better abstraction and uniformity, essential for efficiently scaling. He wanted an all IP network instead of the mess of VLANs Amazon had at the time, so we designed it, built it, and worked with developers so their applications would work with it.</blockquote><p>From their own experience, they knew that maintaining servers eats up the majority of time and money. This push for universal infrastructure no doubt came from Bezos’ relentless prioritization of customers. Bezos famously asks every team to leave an empty seat in meetings for their customer, as a demonstration of just how customer-centric the company should be. In this case, the better, more comprehensive infrastructure Amazon offers, the better support its customers would enjoy. And so AWS was born into a world starved of affordable, reliable and all-encompassing IaaS.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*YNMLyksgidAkQS6k.png" /></figure><h4>But Why is Amazon the Chosen One?</h4><p>Amazon has a historical lead in an industry so new that <a href="http://www.forbes.com/sites/joemckendrick/2012/08/29/most-americans-dont-understand-cloud-computing-does-it-really-matter/">few people understand</a> truly understand it. Some call it a Coke without a Pepsi competitor. AWS’s biggest IaaS challengers are Microsoft Azure, Google Compute Engine and IBM Softlayer. To supplement the Gartner matrix above, take a look at the difference in revenue last year–AWS is raking in more than its top competitors, including hybrid servicers, <em>combined:</em></p><figure><img alt="" src="https://cdn-images-1.medium.com/max/697/0*f0P9FXyX-XukQ9Ow.png" /></figure><p>Its legendary lead is a result of three core reasons. First, much of this growth is in parallel with the rise of Cloud computing itself. You can see the steady increase of Cloud popularity and interest via Google Search Trends. It starts to rise around 2007, just one year after the release of Amazon’s two most widely acclaimed services: Elastic Compute Cloud (EC2) that maximizes compute capacity and Simple Storage Service (S3), which stores massive data.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/945/0*Sp6n2HBebaYCHdQr.png" /></figure><p>Second, Amazon’s EC2 and S3 were the very first widely accessible virtual infrastructure services by a number of years. It’s part of cloud computing history. AWS had been working on solving a pain point that’s common to all developers, and perfected the solution long before anyone else in the industry.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/800/0*ziHhjKUa0VRy-HSU.png" /></figure><p>Third, when the mindset started shift from apprehension about the Cloud to a necessary gravitation to the Cloud, existing players could only scramble to copy AWS services. Microsoft’s Windows Azure, for instance, started off as a Platform-as-a-Service (PaaS), but kept losing to AWS. Microsoft <a href="https://www.deepdyve.com/lp/institute-of-electrical-and-electronics-engineers/is-amazon-becoming-the-new-cool-software-company-for-developers-zRKvJJX4cD?impressionId=55dc82fdc088d&amp;i_medium=mydeepdyve&amp;i_campaign=currentlyReading&amp;i_source=currentlyReading"><em>had</em></a> to add IaaS capabilities to stay in the Cloud game, becoming a hybrid service and rebranded as “Microsoft Azure.” Then, Google followed the lead and launched its own virtual server service, marking the start of copycats.</p><p>As a result of these copycats, there’s been a significant price war to developers’ benefit. Specifically, AWS has dropped its price <a href="https://aws.amazon.com/blogs/aws/aws-price-reduction-42-ec2-s3-rds-elasticache-and-elastic-mapreduce/">49 times in 8 years</a>. But what’s even more impressive is some scrambling competitors rely on AWS to provide IaaS to their own customer base. We mentioned DigitalOcean’s dependence on AWS earlier in this piece.</p><p>But Target.com’s story is even more telling. It had been a customer of AWS since 2001, until it decided to go its separate ways and build its own server. A little disheartened, but still amicable, AWS helped Target.com transfer its data. But after one popular promotion, the site <a href="https://www.youtube.com/watch?v=Xx92bUw7WX8">crashed</a>. It’s unsettling moments like this that light a fire under any infrastructure to capitalize on AWS’s offerings for additional support.</p><p>Moving forward, AWS isn’t settling to dominate the IaaS market. At the end of 2014, it announced a number of new PaaS tools to bolster developer’s paradise. This includes: Code Commit, Code Pipeline and Code Deploy. <a href="https://www.deepdyve.com/lp/institute-of-electrical-and-electronics-engineers/is-amazon-becoming-the-new-cool-software-company-for-developers-zRKvJJX4cD?impressionId=55dc82fdc088d&amp;i_medium=mydeepdyve&amp;i_campaign=currentlyReading&amp;i_source=currentlyReading">David Bernstein</a>, CEO of Cloud Strategy Partners, sees AWS becoming any developer’s comprehensive environment.</p><h4>The Cost of Supreme Excellence</h4><p>After Pinkham was appointed to execute AWS, it was time to get to work. The AWS might have started with Pinkham and a handful of engineers sent to Africa, where he was based. But <a href="http://www.quora.com/Is-AWS-the-worst-team-to-work-for-at-Amazon-Seattle-For-what-specific-reasons">it’s</a> grown to a massive organization under Amazon’s umbrella. A former EC2 engineer says there are several teams that are dedicated to each offering (e.g. S3 team).</p><p>A recent <a href="http://www.nytimes.com/2015/08/16/technology/inside-amazon-wrestling-big-ideas-in-a-bruising-workplace.html?_r=0">New York Times Amazon in-depth expose</a> reveals some awful things about Amazon’s culture in general. Referring to it a “bruising workplace,” reporters cite unforgiving examples of lack of empathy by Amazonian leaders who prioritize work above all. Some <a href="https://www.linkedin.com/pulse/amazonians-response-inside-amazon-wrestling-big-ideas-nick-ciubotariu">Amazonians</a> have responded with claims of inaccuracies and false depictions of isolated incidents strung together to depict a hellish culture.</p><p>Whether or not these anecdotes are truly representative of Amazon’s culture, one thing is certain: It takes herculean dedication to achieve excellence, especially to that of AWS’s caliber. This kind of market leadership doesn’t come without cost of sweat and tears. It’s always subjective to judge a company’s culture–what may be a joyous challenge to one might be relentlessly poor balance of work and life to another. Such high-performing teams can be self-selecting. After all, every single Amazonian chose to be there and most likely has InMail invitations from top tech companies waiting to be read.</p><p>Granted this is not a scientific measure, <a href="http://www.indeed.com/cmp/Aws/reviews">most reviews</a> of the AWS team are glowing. Several AWS engineers can attest to the grueling workplace, but still express gratification in their role in trailblazing their industry:</p><blockquote>I worked for EC2 in Cape Town, South Africa. It was the best!!!! I can’t imagine ever finding a working environment as cool as what I had in my team. That said, there were on-call weeks where I was cursing the company and my job at 4am, being awake for the 3rd consecutive night. But the org is aware of problems like heavy on-call load. They started a program to improve unnecessary tickets. I found AWS (at least in Cape Town) to be a really well-run place to work.</blockquote><p>Bezos himself is very clear that this type of revolutionary environment may not be for everyone. In one meeting, a female engineer asked what Amazon will do to better the work-life balance? His response is clear as daylight and indicative of severely high expectations:</p><blockquote>“The reason we are here is to get stuff done, that is the top priority,” he answered bluntly. “That is the DNA of Amazon. If you can’t excel and put everything into it, this might not be the place for you,” he says, according to the <a href="http://www.amazon.com/The-Everything-Store-Bezos-Amazon/dp/0316219282">book</a> on the history of Amazon.</blockquote><p>For better or worse, this is the culture that lead to the success of AWS today. Bezos was almost prophetic when he green-lit Pinkham and Black’s proposal to sell Amazon’s internal virtual service. By focusing his talented engineers’ energy on the infrastructure, and laying out a rigid culture of excellence, AWS is “winning” the market share for now.</p><p><strong>Developers, what has been your experience with AWS…is AWS too big to fail or can competitors knock it off the #1 spot?</strong></p><p>If you enjoyed reading this, <a href="http://hackerrank.us10.list-manage.com/subscribe?u=9db129c325e2634cb417f3d55&amp;id=47d9c142da">please subscribe</a> to our newsletter for an occasional update when we have something new to share!</p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/how-amazon-web-services-surged-out-of-nowhere/"><em>blog.hackerrank.com</em></a><em> on August 26, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=dcde19739147" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Dark Side of Recruiting Pre-Internet]]></title>
            <link>https://medium.com/@ritikatrikha/the-dark-side-of-recruiting-pre-internet-13d8f0171013?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/13d8f0171013</guid>
            <category><![CDATA[hiring]]></category>
            <category><![CDATA[recruiting]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:53:50 GMT</pubDate>
            <atom:updated>2015-09-20T18:53:50.886Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/530/0*O9uhhVp-D_RtMlop.jpg" /></figure><p>Before boolean search strings could magically populate screens with names, you could only flip through stacks of Yellow Pages. Before the Cloud neatly organized the bulk of the professional population, there was only the Rolodex. Have you ever stopped to think, what would recruiting be without the Internet?</p><p>It was a darker time.</p><p>Without instant access to databases, recruiters were left with their quick wit to stealthily snag the right people who would go on to help build today’s empires of innovation.</p><p>You had to painstakingly fill thousands of index cards in your prized Rolodex and keep carbon copies as a backup. You had to burn the midnight oil every single week to create costly advertisements, sensational kiosks and clever mobile billboards. Drowning in a sea of thick, glossy resumes, you were blind to candidates’ true skills and personality. After lengthy interviewing, your reputation depended on the success of your candidates. Referrals were everything.</p><p>It’s bizarre to think what recruiters had to go through back in the day to successfully build strong teams. Some devised clever ruses for a short-term fix. But even with the advent of the Internet, recruiters with enough grit to survive the school of hard knocks still make the best recruiters today.</p><h4>Striking Out in the ‘Prettied Up Classifieds’</h4><p>One of the first and foremost things companies did to attract candidates was place an ad in the local paper. It’s odd because these ads were grossly ineffective. In a <a href="https://books.google.com/books?id=YRsEAAAAMBAJ&amp;pg=PA53&amp;dq=job+recruiting&amp;hl=en&amp;sa=X&amp;ved=0CGQQ6AEwCWoVChMI4IGNg_DWxwIVy1qICh0boQ_g#v=onepage&amp;q=job%20recruiting&amp;f=true">1997 article</a> of Computer World, Hewlett-Packard said that 90% of the candidates who called after seeing a newspaper ad were not qualified. This sounds about right, according to two anonymous sources who recruited in Silicon Valley in the 80s.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/608/0*02ABNtbnEb9XAKbw.png" /></figure><p>The classifieds were just how it was always done. And they didn’t come cheap. An ad in San Francisco would cost $10,000 a piece, one <a href="https://books.google.com/books?id=yjsEAAAAMBAJ&amp;pg=PA99&amp;lpg=PA99&amp;dq=cost+of+newspaper+job+ads+per+letter+1995&amp;source=bl&amp;ots=DzLYiEcVBE&amp;sig=lhfbC1jPMTZ2coDJhHd6e1xQsa8&amp;hl=en&amp;sa=X&amp;ved=0CDQQ6AEwA2oVChMIrb-8xeXbxwIVDCqICh3x6gYJ#v=onepage&amp;q&amp;f=false">1997 InfoWorld article</a> says. Full-page ads with customized colors and logos could cost as much as $30,000. Yet the San Jose Mercury News’ classified section was at least 5X thicker than it is today. And before faxes arrived on the scene in the mid-80s, people actually had to read the ad copy to newspaper folks over the phone.</p><blockquote>“I remember Monday mornings, I’d come in and someone had to clip every single ad you were responsible for running in the Sunday paper, glue them on another piece of paper and then send to invoice,” says one anonymous source.</blockquote><p>With such a lofty sticker price, some employers resorted to <a href="https://books.google.com/books?id=8Qvx21qA9gcC&amp;pg=PA203&amp;dq=job+recruiting&amp;hl=en&amp;sa=X&amp;ved=0CDYQ6AEwAWoVChMI4IGNg_DWxwIVy1qICh0boQ_g#v=onepage&amp;q=job%20recruiting&amp;f=false">wildly exaggerated ads</a>, like promise of a “fast track” career or lofty salary ranges, to lure as many people as possible to help justify the cost. The newspaper ad strategy was just not ideal. And with the proliferation of the Internet, these ads simply shifted online. Online job boards offered ad placement at hundreds of dollars instead of thousands. Some of early big sites were:</p><ul><li>The Monster Board (Now Monster.com)</li><li>Online Career Center (also folded into Monster.com)</li><li>Career Mosaic (owned by Hodes agency, a Monster.com competitor)</li></ul><p>Some said this online marketplace of jobs, which directly link companies and candidates, would make recruiters obsolete, but it never happened. Online job boards weren’t a major breakthrough. The fundamental problem with job ads–whether in print or online–is that they broadcasts specific jobs to the general public. By converting these postings online, employers just casted a wider net to more people with irrelevant skills. As 20-year-recruiting-veteran Carol Shultz says, job boards are “prettied up classified ads.”</p><h4>The Westech Career Fair</h4><p>Those of you who recruited in Silicon Valley in the ‘80s and ‘90s probably remember frequenting Westech, a career fair that housed over 500 up-and-coming tech companies, like Sun Microsystems and Cisco (often confused with the Sysco food brand at the time). These career fairs were the equivalent to phone screenings today, but with an exhausting line of candidates. This yielded in boxes of resumes piled 12-inches high.</p><p>University recruiting was also a huge battlefield for talent. To beat competitors, executives would personally offer “a check of $10,000 if the student would sign the contract on the spot!” says David Cohen, president of human resources consultancy.</p><p>In any case, these career fairs were pretty infrequent–maybe once a quarter max. And<a href="https://books.google.com/books?id=K6Fq1az9NtsC&amp;pg=PA10&amp;dq=job+recruiting&amp;hl=en&amp;sa=X&amp;ved=0CGEQ6AEwCGoVChMIyPy35qrXxwIVCZWICh1kZg1m#v=onepage&amp;q=job%20recruiting&amp;f=true"> Patricia Schultz,</a> director of HR at Associated Banc-Corp had a good point: The best candidates, who probably aren’t seeking a job, don’t really have time to attend career fairs. While career fairs like Westech were a decent way to walk away with a fistful of candidates, you’d still be missing out on the bulk of the best people: The passive candidates.</p><p>So, if newspaper ads and career fairs weren’t ideal, what did that leave old school recruiters with?</p><h4>Receptionists: The Original Highway to Information</h4><p>Here’s where old school recruiting could be a little cunning. To proactively get their foot in the offices of the talent they needed, some recruiters would go through receptionists.</p><p>If you think about it, receptionists were the gateway to talent before LinkedIn and email. They were in charge of organizing and faxing all resumes. They had the names and phone numbers of every single engineering manager in the building. And remember, at this point, there were very few startups. Both companies and people were more established. The average tenure in the US was roughly <a href="http://stats.bls.gov/opub/mlr/1984/10/art2full.pdf">10 years</a> in the 70s and 80s.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/290/0*v97CNDahXvJpWV5C.jpg" /></figure><p>So, it wasn’t uncommon for recruiters to call the front desk at large companies and create different clever ruses to get names out of receptionists. And with the economic boom in the 80s and 90s, temp staffing agencies, which often placed receptionists, skyrocketed. This is evident by an <a href="http://articles.philly.com/1998-07-01/news/25738330_1_health-benefits-temporary-staffing-companies-stock-market">increase</a> of temps’ hourly wage from roughly $7.50 in 1994 to about $10 an hour in 1997. The more temp secretaries there were, the more opportunities to create a ruse. I spoke with 3 different Silicon Valley recruiters of this era who said these ruses weren’t unheard of:</p><ul><li><em>The Barking Dog One recruiter was really great at making barking sounds. So, he’d sound like a dog in the background while another recruiter called the receptionist with a voice of urgency. “We found this dog and we think the owner works at the head of this company. We need the full name or else this dog will be sent to the pound in another city.” In a panic and ridden with concern for the dog,, receptionists would instantly reveal department head names.</em></li><li><em>The Accent A more simple ruse was to call the receptionist faking a foreign accent and speaking in broken English. In an attempt to help the caller, receptionists would offer up various possible names of people at the company. “Do you mean Robert Henson?”</em></li></ul><p>Some recruiters were so good at coming up with clever ruses that they could build out entire organization charts of top companies. Sometimes it was even simpler than this. Back in the day, some companies had a directory of all the names of people who worked at the company right in the lobby. So, you could walk into the office with some made up excuse and write down all the names and leave.</p><p>Of course, none of these ruses were sustainable for two reasons. One, these clever techniques could only get you so far. Starting any relationship with a lie created a creaky bridge. Two, the Internet unplugged the blockade to a sea of valuable contact information that made ruse-ing irrelevant.</p><h4>The More Things Change, The More They Stay the Same</h4><p>The best old school recruiters who withstood the tech boom knew how to build long-term relationships…without LinkedIn. It required painstaking manual research of the product, companies and people. They dig deep into the minds of the experts they covet, searching for patent authors in technology books or striking up interesting conversations with commuters on CalTrains near the best technology companies. With each new wave of revolutionary tools ushered in by the sea of Internet, nothing has replaced the art of selling and personal relationships. It’s why the radical introduction of online job marketplaces never displace recruiters. You can see the uptick trend of the term “recruiters” in books through the digital age:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/0*R5hTxoRhsYfVjQL8.png" /></figure><p>Pre-Internet, a full Rolodex could hold up to 6,000 people, with each of whom you’d have a personal connection with and notes on the margin to remember them by. Today the average recruiter has more than 500 connections, most of whom aren’t much more than a stranger’s profile. <a href="http://www.quora.com/Why-are-LinkedIn-inmail-response-rates-low">Massive batch emails</a> notoriously lead top candidates to simply turn off their notifications.</p><p>Online tools may have opened up the quantity of people to source and recruit, but truly disruptive recruiting requires the ability to maintain quality, ongoing relationship with a niche community. Recruiting passive candidates is something the best old school recruiters <em>had </em>to master to make it in the business. It’s why they make the best recruiters today.</p><p><em>Enjoyed this piece? </em><a href="http://hackerrank.us10.list-manage.com/subscribe?u=9db129c325e2634cb417f3d55&amp;id=47d9c142da"><em>Subscribe</em></a><em> to our free newsletter to get new articles in your inbox.</em></p><p><em>Originally published at </em><a href="http://blog.hackerrank.com/the-dark-side-of-recruiting-pre-internet/"><em>blog.hackerrank.com</em></a><em> on September 8, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=13d8f0171013" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[The Interdependency Of Stanford And Silicon Valley]]></title>
            <link>https://medium.com/@ritikatrikha/the-interdependency-of-stanford-and-silicon-valley-24321b54bd54?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/24321b54bd54</guid>
            <category><![CDATA[silicon-valley]]></category>
            <category><![CDATA[entrepreneurship]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:52:25 GMT</pubDate>
            <atom:updated>2015-09-20T18:52:25.552Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/738/0*PnFiQzdmN2GkCA14.jpg" /></figure><p>There was a time when Stanford University was considered a second-rate engineering school. It was the early 1940s, and the Department of Defense was pressed to <a href="http://steveblank.com/secret-history/">assemble</a> a top-secret team to understand and attack Germany’s radar system during World War II.</p><p>The head of the U.S. scientific research, Vannevar Bush, wanted the country’s finest radio engineer, Stanford’s Frederick Terman, to lead 800 researchers on this secret mission. But instead of basing the team at Terman’s own Stanford lab — a mere <a href="https://www.deepdyve.com/lp/american-institute-of-physics/frederick-e-terman-GThM9LTOnP">attic</a> with a leaky roof — he was sent to the acclaimed Harvard lab to run the mission.</p><p>It’s hard to imagine Stanford passed over as an innovation hub today. Stanford has outpaced some of the biggest Ivy League universities in prestige and popularity. It has obliterated the traditional mindset that eliteness is exclusive to the Ivy League. Stanford has lapped top schools by centuries. It ranks in the top 3 in multiple global and national rankings (<a href="http://www.shanghairanking.com/ARWU2014.html">here</a>, <a href="http://www.forbes.com/sites/forbespr/2013/07/24/stanford-university-ranks-no-1-on-forbes-6th-annual-ranking-of-americas-top-colleges-measuring-student-satisfaction-and-post-graduate-success/">here</a> and <a href="http://time.com/money/best-colleges/">here</a>).</p><p>Plus, survey results point to Stanford as the <a href="http://studenthousingmatters.com/wp-content/uploads/2014/03/CollegeHopesandWorriesSurveyReport2014.pdf">No. 1 choice</a> of most students and parents for the last few years, over Harvard, Princeton and Yale. In fact, even Harvard students <a href="http://www.thecrimson.com/admissions/article/2014/4/22/harvard-not-on-top/">have</a> acknowledged Stanford’s notable rise in popularity.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/693/0*KTK6MljqO7Yt9DjR.png" /></figure><p>But something a little more intriguing is happening on Stanford’s campus…something that goes beyond these academic rankings. Since the beginning of time, the goal of academia has been not to create companies, but to advance knowledge for the sake of knowledge.</p><p>Yet Stanford’s engineering school has had a strong hand in building the tech boom that surrounds it today. It’s not only witnessed, but also notoriously housed, some of the most celebrated innovations in Silicon Valley.</p><p>While Stanford faculty and students have made notable achievements across disciplines, their role in shaping the epicenter of The Age of Innovation is perhaps one of the top — if not the most unique — distinguishers. As the world’s eyes fixate on the booming tech scene in Silicon Valley, Stanford’s affiliation shines brightly in the periphery.</p><p>In return, its entrepreneurial alumni offer among the most generous endowments to the university, breaking the <a href="http://www.nytimes.com/2013/02/21/education/stanfords-fund-raising-topped-1-billion-in-2012.html">record</a> as the first university to add more than $1 billion in a single year. Stanford shares a relationship with Silicon Valley unlike any other university on the planet, chartering a self-perpetuating cycle of innovation.</p><p>But what’s at the root of this interdependency, and how long can it last in the rapidly shifting space of education technology?</p><h2>Fred Terman, The Root Of Stanford’s Entrepreneurial Spirit</h2><p>To truly understand Stanford’s role in building Silicon Valley, let’s revisit WWII and meet Terman. As the leader of the top-secret military mission, Terman was privy to the most cutting-edge, and exclusive, electronics research in his field. While the government was eager to invest more in electronics defense technology, he saw that Stanford was falling behind.</p><p>“War research which is [now] secret will be the basis of postwar industrial expansion in electronics…Stanford has a chance to achieve a position in the West somewhat analogous to that of Harvard of the East,” Terman <a href="https://books.google.com/books?id=e0bVC2FEoSwC&amp;pg=PA73&amp;lpg=PA73&amp;dq=stanford+reputation+wwii&amp;source=bl&amp;ots=fuXhnGDZb0&amp;sig=X3adv9D531mb3ZlcE2kSixm3-Ac&amp;hl=en&amp;sa=X&amp;ved=0CDwQ6AEwBWoVChMIwoymzan2xgIVzSqICh3wgggm#v=onepage&amp;q=stanford%20reputation%20wwii&amp;f=false">predicted</a> in a letter to a colleague.</p><p>After the war, he lured some of the best students and faculty to Stanford in the barren West by securing sponsored projects that helped strengthen Stanford’s reputation in electronics. Here’s a great visualization, thanks to <a href="http://steveblank.com/category/secret-history-of-silicon-valley/">Steve Blank</a>, about how Stanford first fueled its entrepreneurship engine through war funds:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/498/0*R9StM-hC_KygZOwH.png" /></figure><p>This focus on pushing colleagues and students to commercialize their ideas helped jumpstart engineering at Stanford. Eventually, Stanford’s reputation grew to becoming a military technology resource, right up there with Harvard and MIT.</p><p>But Terman’s advocacy of technology commercialization went beyond the military. As the Cold War began, Terman pushed to build the Stanford Industrial Park, a place reserved for private, cutting-edge tech companies to lease land. It was the first of its kind, and famously housed early tech pioneers like Lockheed, Fairchild, Xerox and General Electric.</p><p>The research park was the perfect recipe for:</p><ul><li>A new revenue stream for the university</li><li>Bringing academic and industry minds together in one space</li><li>Inspiring students to start their own companies</li></ul><p>You might say that the Stanford Industrial Park was the original networking hub for some of the brightest minds of technology, merging academia and industry, with the goal of advancing tech knowledge.</p><p>They had a harmonic relationship in which industry folks took part-time courses at Stanford. In return, these tech companies offered great job opportunities for Stanford grads.</p><blockquote><em>Proximity to Silicon Valley is not the most important thing that distinguishes Stanford, but it’s certainly the most unique.</em></blockquote><p>Since then, Stanford’s bridge from the university to the tech industry has been cast-iron strong, notorious for inspiring an entrepreneurial spirit in many students. The most famous story, of course, is that of Terman and his mentees William Hewlett and David Packard, who patented an innovative audio oscillator. Terman pushed the duo to take their breakthrough commercial.</p><p>Eventually, Hewlett-Packard (HP) was born and moved into the research park as the biggest PC manufacturer in the world. To date, he and the late David Packard, together with their family foundations and company, have given more than $300 million to Stanford.</p><p>Because of their proximity to top innovations, Stanford academics had the opportunity to spot technological shifts in the industry and capitalize by inventing new research breakthroughs. For instance:</p><ul><li><strong>Computer Graphics Inc.: </strong>Students were enamored by the possibility of integrated circuit technology and VLSI capability. The Geometry Engine, the core innovation behind computer generated graphics, was developed on the Stanford campus.</li><li><strong>Atheros: </strong>Atheros introduced the first wireless network. Teresa Meng built, with government funding, a low-power GPS system with extended battery life for soldiers. This led to the successful low-power wireless network, which eventually became Wi-Fi.</li></ul><p>These are just a few of some of the most groundbreaking technological innovations sprouted from Stanford soil: Google, Sun Microsystems, Yahoo!, Cisco, Intuit … and the list goes on — to more than 40,000 companies.</p><p>Stanford also has a reputation as a go-to pool for talent. For instance, the first 100 Googlers were also Stanford students. And today, <a href="http://www.independent.co.uk/student/news/the-billionaire-factory-why-stanford-university-produces-so-many-celebrated-web-entrepreneurs-8706573.html">1 in 20</a> Googlers hail from Stanford.</p><h2>Proximity to Silicon Valley Drives its Tech Entrepreneurial Spirit</h2><p>If you stroll along the 700 <a href="https://en.wikipedia.org/wiki/Acre">acres</a> of <a href="https://en.wikipedia.org/wiki/Stanford_Research_Park">Stanford’s Research Park</a>, not only will you see cutting-edge companies like Tesla and Skype, but also world-renowned tech law firms and R&amp;D labs. It’s a sprawling network of innovation in the purest sense of the term — it’s the best place to uproot a nascent idea.</p><p>Proximity to Silicon Valley is not the most important thing that distinguishes Stanford, but it’s certainly the most unique. It’s the hotbed of computer science innovators, deep-pocketed venture capital firms and angel investors.</p><p>At least today, everyone who wants to “make it” in tech is going to Silicon Valley. And — just like Terman’s early Stanford days — it’s where you can meet the right people with the right resources who can help you turn the American entrepreneurial dream into a reality.</p><p>Just look at the increasing number of H-1B visa applicants each year, most of whom work in tech. There were more than 230,000 applicants in 2015, up from 170,000 in 2014. Four <a href="http://www.myvisajobs.com/Reports/2015-H1B-Visa-Category.aspx?T=WC">out of the top 11</a> cities that house the most H-1B visa holders are all in Silicon Valley.</p><p>Plus, an increasing number of non-tech companies are setting up R&amp;D shops in Silicon Valley. Analyst Brian Solis recently <a href="http://blogs.wsj.com/digits/2015/07/22/hacking-hq-new-study-looks-at-non-tech-innovation-centers/">led a survey</a> of more than 200 non-tech companies; 61 percent of those had a presence in Silicon Valley, which helped them “gain access and exposure to the latest technology.”</p><blockquote><em>There’s certainly a robust emphasis on technology entrepreneurship penetrating the campus of Stanford engineers.</em></blockquote><p>Still, opponents often point to media exaggeration that reduce Stanford into a startup-generator. Of course, Stanford’s prestigious curriculum is a draw for top faculty and research across disciplines. But, given the evidence and anecdotes, there’s certainly a robust emphasis on technology entrepreneurship penetrating the campus of Stanford engineers. How can it not?</p><p>Michael Harris, a Stanford alumnus, can attest to a general sense of drive and passion. “It’s not quite as dominant as the media makes it seem,” he said, “but there’s some element of truth.”</p><p>Stanford students are by and large interested in creating real things that have a real effect in the world. The fact that Silicon Valley is right here and students have fairly good access through friends, professors, the school, etc. to people in the industry is definitely a big bonus. It gets people excited about doing work in the tech industry and feeling motivated and empowered to start something themselves.</p><h2>This Entrepreneurial Spirit Is Evolving Into A Sense Of Urgency</h2><p>Terman’s early emphasis on turning the ideas developed in academia into viable products is just as — if not more — rampant today. The most telling evidence is that <a href="http://minimaxir.com/2013/07/alma-mater-data/">Stanford’s campus is producing more tech startup founders</a> than any other campus.</p><p>But what’s even more curious is that some students, particularly in the graduate department, don’t even finish their degrees. It’s monumental to pay thousands of dollars for a master’s degree in computer science, only to leave to launch a startup. Even at the undergrad level, Harris thought about leaving college after doing one amazing internship the summer after his junior year.</p><p>“I will say that working in industry teaches you more things faster about doing good work in industry than school does by a really big margin (order of magnitude maybe),” Harris said, “so I don’t actually think it’s crazy for people not to go back to school other than the fact that some companies seem to think it’s important for someone to have a piece of paper that says they graduated from college.”</p><p>Of course, most people do finish their degrees. But this sense of urgency to leave — whether or not the majority follow through — is palpable.</p><blockquote><em>Will Stanford end up disrupting the very unique factor that distinguishes Stanford from any other university on the planet?</em></blockquote><p>Last year, six Stanford students <a href="http://www.businessinsider.com/r-special-report-at-stanford-venture-capital-reaches-into-the-dorm--2014-12">quit</a> school to work at the same startup. <a href="http://www.businessinsider.com/twenty-stanford-students-quit-school-to-work-for-a-startup-in-a-super-competitive-industry-2013-4">Another 20</a> left for similar reasons the year before that. Apparently, Stanford’s coveted StartX program wasn’t enough for them.</p><p>StartX is an exclusive 3-month incubator program to help meet the demand for students who want to take their business ideas to the market — complete with renowned mentorship and support from faculty and industry experts to help the brightest Stanfordites turn their ideas into a reality.</p><p>In a <a href="https://itunes.apple.com/us/itunes-u/stanford-historical-society/id385664533?mt=10">recent talk</a>, Stanford President John Hennessy proudly spoke about this program as a launchpad for students to scratch their itch for entrepreneurship. But when an audience member asked him about students dropping out of school, he said, “Look, for every one Instagram success, there are another 100 failed photo-sharing sites.” And, he added, “So far, all of the StartX program students have graduated — at least all of the undergrads.”</p><p>Generally, Stanford’s graduation rates have dipped somewhat in recent years. Of students who enrolled in 2009, 90 percent had graduated within 5 years, Stanford <a href="http://www.businessinsider.com/r-special-report-at-stanford-venture-capital-reaches-into-the-dorm--2014-12">said</a>, compared with a 5-year graduation rate of 92.2 percent 5 years earlier. And this is not a bad thing for Stanford. Since the very beginning, a core function of Stanford’s excellence is its investment in its students to build great commercial products — starting with the early days of Terman.</p><h2>The Future: What Will Stanford Be Without Silicon Valley?</h2><p>But both education and the Valley are shifting. The very nature of innovation frees us from brick-and-mortar walls of elite institutions and companies.</p><p>If the best application of technology is to democratize opportunity, then every single person on the planet should have affordable access to Stanford’s world-class education online. The rise of Massive Open Online Courses (MOOC) and online resources are an indication of the future of education.</p><p>It’s a future in which ambitious students have the opportunity to educate themselves. At the forefront of technology, educational institutions, including Stanford, are starting to decentralize the model through online course material.</p><blockquote><em>Stanford shares a relationship with Silicon Valley<br>unlike any other university on the planet.</em></blockquote><p>Meanwhile, Silicon Valley may have pioneered the tech boom, but it’s no longer the only tech hub. Bursts of technological hubs are forming all over the world. In a<a href="http://blog.hackerrank.com/h1-b-visa-cap-the-imminent-threat-to-us-tech-innovation/"> piece on the H-1B visa cap</a>, I found that the top investors in early stage startups have set up shop in India, China and Israel, three of the largest global tech hubs after Silicon Valley.</p><p>Realistically, the H-1B visa cap and city infrastructure can’t practically support exponential growth in Silicon Valley. The nucleus of innovation will eventually shift, deeming the proximity to Silicon Valley irrelevant.</p><p>Plus — as some students aren’t even finishing their degrees — it’ll be worth re-evaluating if thousands of dollars for a master’s in CS at Stanford is really worth the brand name on a resume or access to coffee with top startup founders who happen to reside in Palo Alto.</p><p>But if Stanford’s proximity to Silicon Valley drives its entrepreneurial essence, which helps bolster both the reputation and funding of Stanford, what will happen when the ambitious, startup founders at Stanford start getting their education online?</p><p>Will Stanford end up disrupting the very unique factor that distinguishes Stanford from any other university on the planet? Or will Stanford’s alumni continue to fuel its self-perpetuating cycle of innovation and maintain its reputation as an innovation hub?</p><p>Featured Image: <a href="http://www.shutterstock.com/gallery-283315p1.html">Sean Walker</a>/<a href="http://www.shutterstock.com/">Shutterstock</a></p><p><em>Originally published at </em><a href="http://techcrunch.com/2015/09/04/what-will-stanford-be-without-silicon-valley/"><em>techcrunch.com</em></a><em> on September 4, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=24321b54bd54" width="1" height="1" alt="">]]></content:encoded>
        </item>
        <item>
            <title><![CDATA[Legendary Productivity And The Fear Of Modern Programming]]></title>
            <link>https://medium.com/@ritikatrikha/legendary-productivity-and-the-fear-of-modern-programming-7cac51822dee?source=rss-cf3e272f885------2</link>
            <guid isPermaLink="false">https://medium.com/p/7cac51822dee</guid>
            <category><![CDATA[technology]]></category>
            <category><![CDATA[programming]]></category>
            <dc:creator><![CDATA[Ritika Trikha]]></dc:creator>
            <pubDate>Sun, 20 Sep 2015 18:45:24 GMT</pubDate>
            <atom:updated>2015-09-20T18:45:24.959Z</atom:updated>
            <content:encoded><![CDATA[<figure><img alt="" src="https://cdn-images-1.medium.com/max/738/0*SEGfQfyVudMxYlTy.jpg" /></figure><p>JavaScript master Douglas Crockford once <a href="http://www.goodreads.com/quotes/567523-computer-programs-are-the-most-complex-things-that-humans-make">said</a> that software is the most complex thing that humans have ever created. It’s made up of intricate bits and bytes pieced together like virtual puzzles. The greatest programming minds are capable of using software to multiply massive integers that are bigger than the universe.</p><p>These insurmountable calculations help us achieve extraordinary feats, like routing human beings to the uncharted craters of Mars. By the very nature of the burgeoning computer science discipline, “we’re dealing with things that are on the edge of what humans can handle and more complicated than ever before,” said renowned computer scientist Donald Knuth.</p><p>While no one programming legend can possibly accomplish any big feat solo, there are programmers worthy of fame for their supreme productivity. Every so often, leaders of new revolutionary tools make an explosion in the field that reverberates across generations of new programmers.</p><p>But what’s even more interesting is that some of the highest-achieving programmers — who can make sense of such unfathomable complexity — can’t foresee a lucidly bright future of programming. Several accomplished computer scientists share a grave concern of the shift toward our more fragmented web. Tools that act as layers, like frameworks and packages, are created to help programmers be more productive, but some experts fear they’ll actually have the opposite impact long-term.</p><p>If the foundation of the modern world is built on software, then deconstructing the toolkit of today’s software leaders can help us not only become better programmers, but develop a better future. Contrary to popular belief, greatness isn’t exclusive to unreal legends. Culture critic Maria Popova puts it most eloquently when she says, “Greatness is consistency driven by a deep love of the work.”</p><blockquote><em>True greatness comes with<br>consistent drive to seek new problems,<br>be able to see the floor before the roof and<br>stay curious about what’s inside the black box.</em></blockquote><p>After researching stories on and conducting in-depth interviews regarding seven programming pioneers, from computer scientist Donald Knuth to Linux’s Linus Torvalds, we uncover productivity patterns common to achieving greatness and pitfalls of which to steer clear: There’s never been a widely used programming tool that was created by just one lone wolf in a cave. Sure, Jeff Dean is the trailblazer of the famed distributed computing infrastructure upon which Google towers. Peter Norvig may be immediately associated with JSchema. David Heinemeier Hannson’s pride and joy is the Ruby on Rails framework. But each of these creators had support for their groundbreaking inventions.</p><p>Teamwork is the foundation of an empire that lone wolves simply can’t sustain. It’s why Google, home of world-renowned engineers, <a href="https://www.youtube.com/watch?v=0SARbwvhupQ">doesn’t </a>tolerate lone wolves on campus. It’s the antithesis of “Googliness,” and software development in general, for two core reasons.</p><p>First, the mere proximity to other engineers fuels greatness. When Rob Pike worked at Bell Labs, well before making waves on the Unix team, he <a href="http://interviews.slashdot.org/story/04/10/18/1153211/rob-pike-responds">recalls</a> fond memories of hovering around clunky minicomputers with terminals in a machine room in the Unix Room. “The buzz was palpable; the education unparalleled,: he said. “The Unix Room may be the greatest cultural reason for the success of Unix as a technology.”</p><p>Folks like Ken Thompson and Dennis Ritchie (authors of C Programming Language) would code, sip coffee, exchange ideas and just hang out in the Unix Room. It was this necessity of convening in a physical room that helped turn Unix into what it is today. Since the proliferation of PCs, however, proximity to each other isn’t as rigid in modern programming. Going out of your way to meet with smart engineers, however, is a timeless essential contributing to greatness.</p><p>Just ask Jeff Dean, the famed Googler who often is referred to as the Chuck Norris of the Internet. As the 20th Googler, Dean has a laundry list of impressive achievements, including spearheading the design and implementation of the advertising serving system. Dean pushed limits by achieving great heights in the unfamiliar domain of deep learning, but he couldn’t have done it without proactively getting a collective total of <a href="http://www.quora.com/How-did-Jeff-Dean-switch-from-infrastructure-and-systems-engineering-to-deep-learning-so-quickly">20,000</a> cappuccinos with his colleagues.</p><p>“I didn’t know much about neural networks, but I did know a lot about distributed systems, and I just went up to people in the kitchen or wherever and talked to them,” Dean told Slate. “You find you can learn really quickly and solve a lot of big problems just by talking to other experts and working together.”</p><p>Second, every great coder, with however pristine a track record, must check in their code for a peer review. <a href="http://fourhourworkweek.com/2011/06/07/whats-your-start-up-bus-count-7-myths-of-entrepreneurship-and-programming/">Pivotal Labs</a>, the company behind the software-scaling success of Twitter, Groupon and a dozen other high-growth Silicon Valley startups, requires the freedom for any coder to look at any code. It’s simple: If code is too dependent on one person, your business is susceptible to dire wounds.</p><blockquote><em>Many programmers simply enjoy blasting through code alone.</em></blockquote><p>Even the great Guido van Rossum <a href="http://www.barnesandnoble.com/w/coders-at-work-peter-seibel/1110852622?ean=9781430219484">checks in</a> his Python code, and Thompson checks in C code. Linus Torvalds, author of the biggest collaboration Open Source Software project in history, says he actually judges coders — not by their ability to code — but how they react to other engineers’ code. As a bonus, reading others’ code also can help you become a better coder. You often can see things in the source code that are left unsaid in the office.</p><p>Knuth would wholeheartedly <a href="https://books.google.com/books?id=2kMIqdfyT8kC&amp;pg=PT602&amp;lpg=PT602&amp;dq=The+more+you+learn+to+read+other+people%E2%80%99s+stuff,+the+more+able+you+are+to+invent+your+own+in+the+future,+it+seems+to+me.&amp;source=bl&amp;ots=Ml6nnfLJyJ&amp;sig=vmb_Mb8CUJOLPqCv-Os-jOHirrg&amp;hl=en&amp;sa=X&amp;ved=0CB8Q6AEwAGoVChMIqduk8oW4xwIVjjOICh1ERQI4#v=onepage&amp;q=The%20more%20you%20learn%20to%20read%20other%20people%E2%80%99s%20stuff%2C%20the%20more%20able%20you%20are%20to%20invent%20your%20own%20in%20the%20future%2C%20it%20seems%20to%20me.&amp;f=false">agree.</a> “The more you learn to read other people’s stuff,” he said, “the more able you are to invent your own in the future, it seems to me.”</p><h2>When Collaboration Goes Awry</h2><p>Collaboration is generally a solid learning tool, but can be catastrophic when injected at the wrong time. Hansson has seen too many Open Source Software (OSS) projects fallen victim to premature collaboration. That’s why, for the first 1.5 years of RoR’s life, Hansson had commit rights to the framework. And it took another 4.5 years before he felt comfortable collaborating with another framework to produce RoR version 3. Even then, it wasn’t easy for him.</p><p>“I’ve seen plenty of open source projects being pulled in a thousand different ways because you allow collaboration to happen too early before the culture and vision is established enough so that you can invite enough people safely into the project without them spoiling it,” he says in a Developer’s Life <a href="http://thisdeveloperslife.com/post/1-0-5-homerun">podcast</a>.</p><p>Plus, the truth of the matter is, many programmers simply enjoy blasting through code alone. Solo coding is faster, short-term. You don’t have to worry about communication mishaps. And things are generally more uniform. Engineer Ben Collins-Sussman once <a href="https://www.youtube.com/watch?v=0SARbwvhupQ">asked</a> a room full of programmers:</p><blockquote>How many of you work solo? …Crickets…</blockquote><blockquote>How many of you LIKE to work solo? Nervous laughter and raised hands spread across the room.</blockquote><p>Collaborating is a necessary evil for many of the greats, like Norvig, who is now Director of Research at Google. Norvig makes the observation that too much collaboration is also not as effective. “If you’ve got two good programmers,” he <a href="http://www.barnesandnoble.com/w/coders-at-work-peter-seibel/1110852622?ean=9781430219484">says,</a> “it’s better for them to work independently and debug each other’s work than to say we’ll take 50% hit just for that second set of eyes. 10% of the time it’s good to sit down and have that shared understanding. But I think most of the time, you’re not going to be as effective.”</p><p>For collaborating on a project that lacks a clear vision, unlike that of Hansson, it’s good to figure out what the problem is together. Once you have an idea, great programmers divvy up the work; leave them alone to burn through the code and sync up during review. The best collaboration happens by creating a solid feedback loop, where you can catch one another’s errors before you’re too far into the project.</p><p>John Carmack, known for creating Doom, was also very wary of adding more programmers to his process of achieving his vision of great games. There was a time when Carmack wrote the majority of the basic program, he <a href="http://www.angelfire.com/in/eimaj/interviews/john.carmack.html">says</a>.</p><p>Now, we’ve got lots of situations where, if something is not right, it could be like, “Oh that’s Jan Paul’s code, or Jim’s code, or Robert’s code.” It’s not so much a case where one person can just go in and immediately diagnose and fix things. So, there is a level of inefficiency.</p><p>Again, there’s a limit to what a lone wolf can do. Doom 3 required a lot more features, which meant more programmers. Carmack found this to be a double-edged sword. So, it’s manageable, he says — and necessary — in achieving a grander vision.</p><h2>Jack Of All Trades And Master Of One</h2><p>Most — if not all — of the seven legendary programmers had at least one thing in common: They mastered one well-defined domain, primarily using one language to carry out their work. Jonathon D. Tang pointed this out in a recent <a href="https://news.ycombinator.com/item?id=10011689">Hacker News</a> comment, and it rings true. Knowing your language inside out is key to optimal performance. So, “read the reference, read books that not only show you the mechanics of the language but also debugging and testing,” Norvig advises. Being able to memorize the common calls for your language of choice can help expedite productivity.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/797/1*KafAT07fUbiwPne4izzA4A.png" /></figure><p>But it can get really comfortable (or boring) really fast if you stick to just one set of tools and domain. So, after mastering one definitive domain, most of them have experience in switching contexts, which helps them open their minds and see things in a different way.</p><p>For instance, John Carmack switched from creating video games to Oculus for virtual reality. LIkewise, Rob Pike moved from Plan 9 to Go. Andy Hertzfeld transitioned from writing the original Mac system software in assembly to writing the Google+ Circle Editor in JavaScript. “But rarely do the greats ever try to juggle multiple platform at the same time,” Tang said in a follow-up email. Delving into new domains after mastering one helps you see things in different levels.</p><h2>Visualizing The Program In Your Brain</h2><p>Nearly every programming legend points to the importance of visualizing solutions and being able to hold programs in your head. There’s a lot of productivity lost when you dive into code or start testing without first developing a mental model of the solution.</p><p>Carmack’s ability to hold gaming concepts is among the most remarkable, considering just how massively complex the virtual world of gaming is. “A video game’s program is actually more complex than that of space shuttles sent to the moon and back,” he <a href="https://blogs.uw.edu/ajko/2012/08/22/john-carmack-discusses-the-art-and-science-of-software-engineering/">said</a> in an interview. Paul Miller helps put his work into <a href="https://blog.yourkarma.com/i-love-john-carmack">context</a>. When manipulating light beams to create a virtual world, he renders an image at least 30 times a second to prevent the game from breaking. This adds up to a trillion calculations per second. Meanwhile, Disney’s Pixar takes 10 hours to render a single frame. In video games, you’ve got just milliseconds to make an impact.</p><blockquote><em>It’s all about the ability to see the solution before diving into the problem.</em></blockquote><p>Given the extensiveness of video game programming, Carmack says, “being able to clearly keep a lot of aspects of complex system visualized is valuable. Having a good feel for time and storage that are flexible enough to work over a range of 10 orders of magnitude is valuable.”</p><p>Interestingly enough, Knuth, Norvig, Dean, Pike, Torvalds, Thompson and Hansson have all at one point said they’re believers of having a strong mental model, focus and visualization. It’s all about the ability to see the solution before diving into the problem.</p><p>The best concrete example comes from Norvig. He once was tasked to write a <a href="http://www.barnesandnoble.com/w/coders-at-work-peter-seibel/1110852622?ean=9781430219484">Sudoku</a>-solver program. From the get go, he knew from his AI knowledge that the combination of field of constraint propagation and recursive search would solve the problem. Meanwhile, another programmer tested all sorts of code on his blog, but never really solved anything. It’s perfectly possible to write correct, tested code without correctly approaching the problem.</p><p>Herein lies the key to approaching the problem correctly. “I think it’s useful to imagine the solution, to see if it’s going to work,” said Norvig. “It’s useful to see if it feels comfortable.”</p><h2>There’s Joy Inside The Black Box</h2><p>In Coders at Work, Knuth expresses a major concern for the future of programming if young programmers are simply assembling parts without studying them. The neatly packaged boxes might be a good short-term solution for speed, but programmers will lack the grand visualization that’s necessary for true progress in programming. Plus, it’s just not as fun to copy/paste commands without knowing the fundamentals of why and how it’s happening.</p><p>“If the real case takes a certain time, t, then the complex case takes time 4t. But if you’re allowed to open the box, then you’ll only need three real matrix multiplications instead of four because there’s an identity that will describe the product of two complex matrices,” Knuth explains.</p><blockquote><em>While frameworks, APIs and structures might make programmers feel more productive, true productivity comes from unpacking the containers and truly understanding what’s inside.</em></blockquote><p>In fact, the very purpose of Knuth’s most famous work, The Art of Programming, helped programmers learn how and why data structures worked. “So my book sort of opened people’s eyes: ‘Oh my gosh, I can understand this and adapt it so I can have elements that are in two lists at once. I can change the data structure.’ It became something that could be mainstream instead of just enclosed in these packages.”</p><p>Comparing it to mathematics, it wouldn’t be fun to simply get the right theorem for the right problem each time. The joy comes from trying various theorems, visualizing what might work and getting that thrill when it finally does. Norvig shares this concern and stresses that programmers need to ask more questions before copy/pasting black boxes.</p><p>Sure, the code might have worked once, but what are the failure cases? Is it consistent? Are there other scenarios for expanding functionality? How can you understand it better? Simply relying on prepackaged boxes to carry out a command can be tedious and mundane. It’s more fun to problem-solve, think critically and learn the mechanisms of why code strung together is performing in a certain way.</p><p>Thompson is downright fearful of modern programming because it’s made up of layers upon layers upon layers. “It confuses me to read a program which you must read top-down. It says ‘do something,’ and you go find ‘something’ and it says ‘do something else’ and it goes back to the top maybe. And nothing gets done. I can’t keep it in my mind — I can’t understand it.”</p><p>While frameworks, APIs and structures might make programmers feel more productive, true productivity comes from unpacking the containers and truly understanding what’s inside. Only then can you build upon your knowledge and continue to push the limits of what human beings can achieve.</p><p>The greatest engineers who have brought us this far in software grew up in an entirely different era of computing — packed inside rooms filled with terminals, carrying mental models of new algorithm-based programs. Newer generations of programmers are born into a more fragmented world. The programs today are far too large to carry in our minds. Plugging in black boxes can get you to a certain point — very quickly — but the greatest programmers will always be bored with redundancy. True greatness comes with consistent drive to seek new problems with like-minded programmers, be able to see the floor before the roof and stay curious about what’s inside the black box.</p><p>Featured Image: <a href="http://www.shutterstock.com/gallery-253597p1.html">Mclek</a>/<a href="http://www.shutterstock.com/">Shutterstock</a></p><p><em>Originally published at </em><a href="http://techcrunch.com/2015/09/11/legendary-productivity-and-the-fear-of-modern-programming/"><em>techcrunch.com</em></a><em> on September 11, 2015.</em></p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=7cac51822dee" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>