<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Chief Marketing Technologist</title>
	<atom:link href="http://chiefmartec.com/feed/" rel="self" type="application/rss+xml" />
	<link>http://chiefmartec.com</link>
	<description>Marketing Technology Management</description>
	<lastBuildDate>Wed, 15 May 2013 11:55:58 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.5.1</generator>
		<item>
		<title>Everyone in marketing should be a marketer scientist</title>
		<link>http://chiefmartec.com/2013/05/everyone-in-marketing-should-be-a-marketer-scientist/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=everyone-in-marketing-should-be-a-marketer-scientist</link>
		<comments>http://chiefmartec.com/2013/05/everyone-in-marketing-should-be-a-marketer-scientist/#comments</comments>
		<pubDate>Wed, 15 May 2013 09:34:31 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Management]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=479</guid>
		<description><![CDATA[<p>(This also appears as a guest post on SAS&#8217;s Left of the Date Line blog for the Asia Pacific region.) Later this month, I&#8217;ll have the privilege of meeting with groups of CMOs and other marketing leaders across southeast Asia as part of an event tour with SAS Institute. We&#8217;ll be visiting Singapore, Malaysia, Indonesia, [...]</p><p>The post <a href="http://chiefmartec.com/2013/05/everyone-in-marketing-should-be-a-marketer-scientist/">Everyone in marketing should be a marketer scientist</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-478" alt="8 characteristics of the marketer scientist" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/marketer-scientist.jpg" width="600" height="446" /></p>
<p><em>(This also appears as a guest post on SAS&#8217;s <a href="http://blogs.sas.com/content/anz/2013/05/15/emergent-cmo-marketer-or-scientist/">Left of the Date Line blog</a> for the Asia Pacific region.)</em></p>
<p>Later this month, I&#8217;ll have the privilege of meeting with groups of CMOs and other marketing leaders across southeast Asia as part of an event tour with SAS Institute. We&#8217;ll be visiting Singapore, Malaysia, Indonesia, the Philippines, and India, as well as doing <a href="http://www.sas.com/reg/offer/sp/cmo">a live webcast for Australia and New Zealand</a> on Tuesday, May 21.</p>
<p>The title of my presentation will be <em>The Emergent CMO: Combining Art &amp; Science in Modern Marketing</em>, and I thought I&#8217;d share a sneak preview of what I&#8217;ll be talking about.</p>
<p>In a world where everything is connected, hybrids — people who are able to bridge multiple disciplines — wield tremendous power. They see the interrelationships between things that used to be isolated in silos, and they&#8217;re able to creatively combine them in innovative new ways.</p>
<p>For instance, I&#8217;ve long championed the hybrid role of <a href="http://chiefmartec.com/2010/04/rise-of-the-marketing-technologist/">marketing technologists</a> — technical professionals who apply their talents in the pursuit of marketing. These aren&#8217;t just IT people working indirectly on behalf of marketing. They&#8217;re technical professionals who actually identify themselves as marketers. They&#8217;re genuinely passionate about marketing. And they&#8217;re enthusiastically seeking ways to leverage their technical knowledge in the pursuit of breakthrough marketing ideas.</p>
<p>Of course, not everyone in marketing needs to be a marketing technologist.</p>
<p>However, I have come to believe that <em>everyone</em> in marketing should strive to become a broader kind of hybrid: a <strong>marketer scientist</strong>. Like a warrior poet or a philosopher king, but for modern marketing.</p>
<p>There&#8217;s been a lot of talk lately about the art and science of marketing. Some believe that the explosion of data and technology in our field is pushing out the more creative, intuitive, and human aspects of marketing. This is sometimes framed as &#8220;science&#8221; replacing &#8220;art.&#8221; I put those terms in quotes because their interpretation varies depending on who you&#8217;re talking to and in what context. Generally, people seem to equate left-brain thinking with science and right-brain thinking with art.</p>
<p>But of course, that&#8217;s highly oversimplified. As it turns out, real science is an incredibly creative discipline. Einstein was a great scientist because of his imagination, far more than his math. Vice versa, great art can be highly analytical and systematic in its execution. Beethoven&#8217;s 9th Symphony is a work of creative beauty, but also one of great precision.</p>
<p>The art and science of marketing is not a trade-off between two opposing forces. Instead, modern marketing is a synthesis of these two worldviews. Marketing must embrace more science, but that doesn&#8217;t mean it should abandon its art. We can be both creative <em>and</em> analytical. The key is to appreciate the strengths of these two worldviews and apply them in concert together.</p>
<p>That is the ideal of a hybrid marketer scientist.</p>
<p>To illustrate this, let&#8217;s consider eight characteristics of a marketer scientist — four that emphasize the &#8220;marketer&#8221; half and four that emphasize the &#8220;scientist&#8221; half:</p>
<p>The marketer half of this hybrid combines:</p>
<ul>
<li>Storyteller</li>
<li>Brand champion</li>
<li>Experience designer</li>
<li>Change agent</li>
</ul>
<p>Marketers have always been storytellers and brand champions, and those responsibilities are more important than ever. Great storytelling must break through the Internet&#8217;s content cacophony, where now everyone is a publisher with an industrial-strength printing press. And in the connected world of social media, every touchpoint with every customer can directly contribute to — or detract from — brand equity in a significant way.</p>
<p>Digital has blurred the line between customer communications and customer experiences. Stories are now best told through experiences, and experiences have become the backbone of the brand. Therefore, marketers must take the lead with experience design. Chief Customer Officer. Chief Experience Officer. These are <em>marketing</em> roles.</p>
<p>Because these changes in marketing are so significant — and they&#8217;re happening so rapidly — ultimately a marketer must become a <em>change agent</em>, helping the organization as a whole embrace new opportunities and new approaches.</p>
<p>This is especially true with the scientist half of this hybrid, which combines:</p>
<ul>
<li>Data analyst</li>
<li>Experimentalist</li>
<li>Technologist</li>
<li>Systems thinker</li>
</ul>
<p>Marketers must be fluent with using data to make better decisions and to deliver better customer experiences. In particular, we must be able to harness data the way scientists do: providing inspiration for new ideas and — through controlled experiments — proving which of our theories are correct. The modern marketer must be an experimentalist, comfortable with continually trying new ideas on a small scale, with low risk, and then ramping up the demonstrated winners.</p>
<p>Not everyone needs to be a heavy-duty, code-wielding marketing technologist, that&#8217;s true. But in a marketing environment where technology powers just about everything, every marketer should at least be willing to embrace technology as a means to an end. Scientists look to technology as better tools to push the frontier of what science is capable of achieving.</p>
<p>Finally, marketers must integrate these different pieces into a unified worldview as systems thinkers. Any one channel, tactic, approach, etc., cannot be viewed as an isolated component, but rather as part of a greater whole. That&#8217;s certainly how customers experience our brands. This will require changes to the way in which we organize marketing — adopting new management methodologies such as <a href="http://chiefmartec.com/2013/03/agile-marketing-for-a-world-of-constant-change/">agile marketing</a>.</p>
<p>Admittedly, this is a lot under one hat.</p>
<p>Rest assured that not every marketer needs to be an <em>expert</em> in each of these eight characteristics. But every marketer should have a little piece of each of these integrated into their thinking. One marketer might be an expert storyteller, but only modestly proficient as using data to help tell those stories and measure which ones resonate best. Another marketer might be an expert technologist, but mostly embrace the role of brand champion in the context of making sure that their technical implementations fulfill brand promises.</p>
<p>Ultimately, being a marketer scientist is less about a specific set of skills and more of philosophy for modern marketing. Marketer scientists balance the art and science of marketing together in harmony.</p>
<p>The post <a href="http://chiefmartec.com/2013/05/everyone-in-marketing-should-be-a-marketer-scientist/">Everyone in marketing should be a marketer scientist</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/everyone-in-marketing-should-be-a-marketer-scientist/feed/</wfw:commentRss>
		<slash:comments>7</slash:comments>
		</item>
		<item>
		<title>How EMC successfully adopted agile marketing</title>
		<link>http://chiefmartec.com/2013/05/how-emc-successfully-adopted-agile-marketing/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=how-emc-successfully-adopted-agile-marketing</link>
		<comments>http://chiefmartec.com/2013/05/how-emc-successfully-adopted-agile-marketing/#comments</comments>
		<pubDate>Mon, 13 May 2013 12:00:07 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Agile Marketing]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=475</guid>
		<description><![CDATA[<p>Agile marketing has been gaining a lot of steam over the past year, but we&#8217;re still in the &#8220;early adopter&#8221; stage of this movement. (If you have no idea what agile marketing is, I recently posted a video introduction to agile marketing as well as an essay version.) Most teams that have adopted agile marketing [...]</p><p>The post <a href="http://chiefmartec.com/2013/05/how-emc-successfully-adopted-agile-marketing/">How EMC successfully adopted agile marketing</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignright size-medium wp-image-476" style="margin: 25px;" alt="EMC" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/emc_logo-300x147.png" width="300" height="147" /></p>
<p>Agile marketing has been gaining a lot of steam over the past year, but we&#8217;re still in the &#8220;early adopter&#8221; stage of this movement.</p>
<p>(If you have no idea what agile marketing is, I recently posted a <a title="Introduction to agile marketing (video presentation)" href="http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/">video introduction to agile marketing</a> as well as an <a title="Agile marketing for a world of constant change" href="http://chiefmartec.com/2013/03/agile-marketing-for-a-world-of-constant-change/">essay version</a>.)</p>
<p>Most teams that have adopted agile marketing have had to figure it out on their own, improvising from ideas of agile development and adapting the process as they go along. There are precious few published stories of how real teams have struggled through that process that others could use as a reference and inspiration.</p>
<p>So I was thrilled when David Quinn and Amy Callahan of EMC agreed to share their pioneering experiences with adopting agile marketing in the following Q&amp;A:</p>
<p><strong>To start, can you tell us a little bit about each of your backgrounds and your roles at EMC?</strong></p>
<p><img class="alignright size-thumbnail wp-image-474" alt="David Quinn" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/DQ-Headshot_300-150x150.jpg" width="150" height="150" /></p>
<p><em>David Quinn, Senior Director, Corporate Marketing Engagement Office</em></p>
<p>I&#8217;ve led a variety of marketing functions for EMC in both web marketing and marketing support. Currently leading the Engagement Office within the corporate marketing organization as we define, deploy and refine new methodologies for success within the marketing organization.</p>
<p><em>Amy Callahan, Senior Engagement Manager, Corporate Marketing Engagement Office</em></p>
<p><img class="alignright size-thumbnail wp-image-473" alt="Amy Callahan" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/Amy-Headshot_300-150x150.jpg" width="150" height="150" /></p>
<p>Coming from a high-tech, account management background, I joined EMC seven years ago, holding various positions throughout web marketing. I volunteered to help build out the &#8220;agile pilot&#8221; two years ago, which led to my current role as a senior engagement manager.</p>
<p><strong>What motivated you to embrace agile marketing in the corporate marketing team? Where did the inspiration come from?</strong></p>
<p>It was not really a case of &#8220;deciding&#8221; to utilize agile marketing, but rather a result of addressing real business problems we faced within the corporate marketing organization.</p>
<p>We had been battling a set of parallel issues while trying to take on the vast amounts of work that come into the CM organization. On one hand, the corporate marketing groups were overwhelmed with requests, actions and deliverables that were thrust upon them on a daily basis. With no particular prioritization or synchronization it was difficult to know which activities were critical and which could be addressed later. Also, each group made priority decisions in a vacuum.</p>
<blockquote><p>With no particular prioritization or synchronization it was difficult to know <strong>which activities were critical and which could be addressed later</strong>.</p></blockquote>
<p>At the same time, business owners — those people and groups who needed the corporate marketing teams&#8217; services — were knocking on the doors of the CM teams, telling their story and asking for help — sometimes several times over — as they attempted to cover all the requisite functions.</p>
<p>Needless to say, not everyone heard the same things and, as noted, not everyone prioritized the work in the same fashion. In addition, it was often the case that a business owner simply did not think about a particular area of corporate marketing that could bring value to their project, and therefore certain areas were overlooked.</p>
<p>It was then that our new Senior VP of Corporate Marketing, Jonathan Martin, recognized the need for change. He asked us to look at the problem and consider some radical solutions to the way we conducted our business — inclusive of the agile concepts that we were somewhat familiar with from our prior web experience around software development.</p>
<p><strong>How did you get started? What were some of the challenges you faced in adopting an agile approach, and how did you overcome them?</strong></p>
<p>Because this was uncharted territory and there was no Engagement Office or Engagement function in existence, I looked around my existing organization and asked for volunteers who were looking for a challenge. Fortunately, several people raised their hands and decided that a second job, in addition to their current one, seemed like a good idea. Truthfully, these folks saw an opportunity to solve a real business problem and work on something that was truly cutting edge.</p>
<p>This mini team met daily for a number of hours and took the time to diagnose the real issues. While we really wanted to dig into our effort of &#8220;marketizing&#8221; the agile development process, the team recognized the gravity of introducing major change into our current environment — therefore sound research needed to proceed action.</p>
<p>Rather than move forward with a new set of ideas, we initially worked with each functional group within CM to get <em>their</em> perspective on the issues at hand. We did the same thing with other parts of the business that were looking to the CM organization for help. It was literally a case of documenting the pain points and presenting it back to the various constituencies to make sure we had captured their thoughts and issues.</p>
<blockquote><p>In true agile form, we applied a process framework and iterative plan but recognized that we needed to be flexible: <strong>try it, learn from it, and adjust as necessary</strong>.</p></blockquote>
<p>Once we completed that effort we began to build a process that incorporated agile methodologies seen in the development world and applied those to the problem at hand. Then it was time to jump in with both feet and give it a try. We picked one existing campaign effort and built a pilot team around those activities as our first real &#8220;engagement.&#8221; In true agile form, we applied a process framework and iterative plan but recognized that we needed to be flexible — that is, try it, learn from it, and adjust as necessary.</p>
<p>The initial challenges within the pilot, once we scaled the program, were very much the same. The frequency of meetings, albeit only 15 minutes in duration, were frustrating for some of the subject matter experts. The role of Engagement Manager was initially confusing to some, as it was not a typical project manager role, but rather an effort to facilitate and enable a true team atmosphere and effort.</p>
<p>In the end, we can sum up the biggest challenge in one simple word: <em>change</em>. Change is hard, change is uncomfortable and change is typically met with resistance. The initial feedback was not overly positive and not all parties were embracing this new methodology.</p>
<blockquote><p>We can sum up the biggest challenge in one simple word: change. Change is hard, change is uncomfortable and <strong>change is typically met with resistance</strong>.</p></blockquote>
<p>In time, we did overcome the resistance, the backlash, and the frustrations. We were successful for two reasons. We did our homework. We never decided for others what their problems were. We let them define the issues. And when we began to utilize the agile methods, we were able to point back to specific pain points and show just how the new methods addressed those particular issues.</p>
<p>Additionally, our team fully bought into the lean agile concepts. We built out a full process by spending many hours reviewing results and commentary, adapting those thoughts by refining our process, and creating more predictable outcomes.</p>
<p><strong>What are the different roles and responsibilities in your agile marketing teams?</strong></p>
<p>In each engagement there are three types of roles:</p>
<p>1. The <strong>Business Owner</strong> is in effect any individual or group that comes forward with a project or request that requires the services of multiple corporate marketing functions. They can come from any part of the company with a wide variety of asks, from product launches to campaigns to marketing programs. The Business Owner participates in all the activities throughout the agile process.</p>
<p>2. The <strong>Engagement Manager</strong> is responsible for driving and enabling the team on a particular project or effort. They function as a front door to marketing and work much like an agency to pull together a virtual team based on the needs of a particular project. They have been trained to advocate for all Corporate Marketing functions so they can offer the Business Owner (the requestor) advice on what groups should be &#8220;at the table.&#8221; They drive the engagement throughout and pull together all relevant meetings while not inhibiting the one-on-one collaboration between key stakeholders.</p>
<p><strong>3.</strong> The <strong>Subject Matter Experts</strong> (SMEs) make up the third portion of the team. Each relevant functional team assigns a representative to each engagement to represent that team throughout the effort. As part of the engagement effort they are now able to be at the table earlier and concentrate on proactive consultation versus reactive fire drills.</p>
<p><strong>Can you walk us through the process — what are the steps of an agile marketing project with your group?</strong></p>
<p>In its simplest form, the engagement steps consist of:</p>
<ul>
<li>A business request</li>
<li>Business Objectives Meeting</li>
<li>Iterative Planning Meeting</li>
<li>Sprint Sets</li>
<li>Launch</li>
<li>Demonstration</li>
<li>Retrospective</li>
</ul>
<p>The Engagement Manager meets with the requestor to define the marketing backlog and pulls together the key players so that all members hear the same story at the same time. This provides the opportunity for all members of the virtual team to comment and collaborate on additional ideas.</p>
<p>Sprint sets are defined, and the cadence for stand-up meetings is agreed upon and the process begins. It results in continuous output that depletes the existing backlog and allows for ongoing prioritization.</p>
<p>Finally, mandatory demonstration and retrospective meetings provide everyone the chance to see the greater results and to reflect on the engagement as a whole. Valuable insights are brought back to the Engagement Office and fed back into the process as appropriate.</p>
<p><strong>Can you share with us one or two examples of the kinds of projects that have been successful with agile marketing?</strong></p>
<p>Our plan for launching new products has been completely refined using the agile methodology. We built an agile &#8220;recipe&#8221; for each launch tier that provides teams a track to run on, making the entire effort simpler and completely transparent, while allowing for the subtle changes necessary in each launch effort.</p>
<blockquote><p>This lean approach has helped to support what we believe is critical thinking: <strong>do fewer things better</strong>.</p></blockquote>
<p>Our campaign activities have all gone through the process and have been very successful. The sheer volume of assets and activities associated with each campaign have benefited from the new model. Constant prioritization and the ability to plan activities and deliverables throughout the year has been rewarding to all involved. This lean approach has helped to support what we believe is critical thinking: &#8220;Do fewer things better.&#8221;</p>
<p><strong>Looking back, what would you say have been the greatest benefits of agile marketing?</strong></p>
<p>The ability to focus and prioritize for the CM Groups — they know how to schedule work based on the overall needs and each group understands the bigger picture without guessing.</p>
<p>Time management. The Business Owners don&#8217;t spend days trying to get around to each functional group to present their ask. And while all team members balked initially at the idea of regular stand up meetings, they eventually agreed that frequent short meetings eliminate the need for many long drawn out meetings with various groups trying to get in line with the activities of the others.</p>
<blockquote><p><strong>The &#8220;corporate nod&#8221; is just not going fly during a stand-up meeting</strong> when you’re on the hook for a deliverable that other team members are waiting on.</p></blockquote>
<p>Accountability through transparency. Great teams establish good ground rules. It&#8217;s easier to challenge people when these rules are well known. A good Engagement Manager can make visible the differences to achieve alignment. The &#8220;corporate nod&#8221; is just not going fly during a stand-up meeting when you&#8217;re on the hook for a deliverable that other team members are waiting on to start their processes. This type of interaction becomes so important, especially in today&#8217;s global/remote team world.</p>
<p><strong>If you could offer one key piece of advice to CMOs who are considering adopting agile marketing, what would you tell them?</strong></p>
<p>We would like to offer two:</p>
<p>1. Agile Marketing teams need to act in a manner like their name. There is no one process or solution that is &#8220;right.&#8221; What works for one company or organization is not necessarily the perfect recipe for another. Be flexible, try it out, and be ready to change. Assume you will have to re-craft your effort and reorganize your process. But don&#8217;t be afraid to try it and fail — just take the learnings and apply them quickly. The world will not come to an end. Be agile yourself.</p>
<blockquote><p>Don&#8217;t be afraid to try it and fail — just <strong>take the learnings and apply them quickly</strong>. Be agile yourself.</p></blockquote>
<p>2. Understand from the beginning that change is hard. No one wants to change the way they do things. It&#8217;s not comfortable. It&#8217;s scary. It&#8217;s threatening. Understand all of these things. Your teams <em>will</em> feel this way and they will react. That said, if you understand it and show them — versus forcing them — that the change actually benefits them in specific areas <em>they</em> have identified as problems or difficult tasks, they will embrace the change.</p>
<p><em>Thank you, David and Amy!</em></p>
<p>The post <a href="http://chiefmartec.com/2013/05/how-emc-successfully-adopted-agile-marketing/">How EMC successfully adopted agile marketing</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/how-emc-successfully-adopted-agile-marketing/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>The very cool marketing technology LUMAscape</title>
		<link>http://chiefmartec.com/2013/05/the-very-cool-marketing-technology-lumascape/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=the-very-cool-marketing-technology-lumascape</link>
		<comments>http://chiefmartec.com/2013/05/the-very-cool-marketing-technology-lumascape/#comments</comments>
		<pubDate>Fri, 10 May 2013 13:46:46 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Software]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=471</guid>
		<description><![CDATA[<p>Terry Kawaja and the brilliant folks at LUMA Partners — a modern investment bank specializing in the intersection of media and technology — have just released their Marketing Technology LUMAscape, shown above. A few years ago, Terry put together a similar landscape for the more specialized ad tech space, which became the reference document for [...]</p><p>The post <a href="http://chiefmartec.com/2013/05/the-very-cool-marketing-technology-lumascape/">The very cool marketing technology LUMAscape</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-470" style="margin-top: 25px; margin-bottom: 25px;" alt="Marketing Technology Lumascape" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/martec_lumascape_600.jpg" width="600" height="449" /></p>
<p><a href="https://twitter.com/tkawaja">Terry Kawaja</a> and the brilliant folks at LUMA Partners — a modern investment bank specializing in the intersection of media and technology — have just released their <a href="http://www.lumapartners.com/lumascapes/marketing-technology-lumascape/"><strong>Marketing Technology LUMAscape</strong></a>, shown above.</p>
<p>A few years ago, Terry put together a similar landscape for the more specialized <a href="http://www.lumapartners.com/lumascapes/display-ad-tech-lumascape/">ad tech space</a>, which became <em>the</em> reference document for that industry. It was also what inspired me to create a <a href="http://chiefmartec.com/2012/09/marketing-technology-landscape-supergraphic-2012/">marketing technology landscape</a> in a similar vein.</p>
<p>However, while my landscape was intended just to help people visualize the sheer breadth and diversity of the marketing technology space, Terry and his team have clearly put a lot more work into illuminating the structure of the industry — for instance, how categories relate to each other into meta-categories.</p>
<p>They also use dashed red boxes to identify firms that have been acquired, but whose technologies are still active in the market. This is very helpful to see which categories have been hotbeds of acquisition and <a href="http://chiefmartec.com/2012/09/is-marketing-technology-consolidating-or-diversifying/">consolidation</a>, which categories are still more independent, and where there is more red ocean competition or more open greenfield.</p>
<p>Nicely done!</p>
<p>The post <a href="http://chiefmartec.com/2013/05/the-very-cool-marketing-technology-lumascape/">The very cool marketing technology LUMAscape</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/the-very-cool-marketing-technology-lumascape/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Introduction to agile marketing (video presentation)</title>
		<link>http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=introduction-to-agile-marketing-video-presentation</link>
		<comments>http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/#comments</comments>
		<pubDate>Thu, 09 May 2013 10:55:30 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Agile Marketing]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=467</guid>
		<description><![CDATA[<p>Last month, I presented a talk on Agile Marketing: Managing Marketing in a World of Constant Change at the Marketo User Summit in San Francisco. They professionally recorded the session, and with their permission, I&#8217;m pleased to be able to share the video and synchronized slide deck with you:</p><p>The post <a href="http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/">Introduction to agile marketing (video presentation)</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p>Last month, I presented a talk on <a title="Agile marketing for a world of constant change" href="http://chiefmartec.com/2013/03/agile-marketing-for-a-world-of-constant-change/"><strong>Agile Marketing: Managing Marketing in a World of Constant Change</strong></a> at the <a href="http://www.marketo.com">Marketo</a> User Summit in San Francisco. They professionally recorded the session, and with their permission, I&#8217;m pleased to be able to share the <a title="Agile Marketing Video" href="http://watch.knowledgevision.com/f3f9a64c4ac64ddf8982b85dddc579b5" target="_blank">video and synchronized slide deck</a> with you:</p>
<p><a href="http://watch.knowledgevision.com/f3f9a64c4ac64ddf8982b85dddc579b5" target="_blank"><img class="alignnone size-full wp-image-466" style="margin-top: 25px; margin-bottom: 25px;" alt="Agile Marketing Video" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/agile_marketing_marketo.jpg" width="600" height="415" /></a></p>
<p>The post <a href="http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/">Introduction to agile marketing (video presentation)</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/introduction-to-agile-marketing-video-presentation/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>The New Kingmakers are a rising force in marketing too</title>
		<link>http://chiefmartec.com/2013/05/the-new-kingmakers-are-a-rising-force-in-marketing-too/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=the-new-kingmakers-are-a-rising-force-in-marketing-too</link>
		<comments>http://chiefmartec.com/2013/05/the-new-kingmakers-are-a-rising-force-in-marketing-too/#comments</comments>
		<pubDate>Wed, 08 May 2013 10:22:41 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Management]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=464</guid>
		<description><![CDATA[<p>In a world powered by software, the developers who create that software — especially the really good ones — are increasingly the center of influence and power in business. That&#8217;s the core thesis of Stephen O&#8217;Grady&#8217;s brief-but-brilliant, 48-page book, The New Kingmakers: How Developers Conquered the World. This is highly relevant to marketers and marketing [...]</p><p>The post <a href="http://chiefmartec.com/2013/05/the-new-kingmakers-are-a-rising-force-in-marketing-too/">The New Kingmakers are a rising force in marketing too</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-463" alt="The CIO is the last to know" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/venn-diagram-developers-e1368008168799.png" width="600" height="341" /></p>
<p><img class="alignright size-full wp-image-462" alt="The New Kingmakers" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/newkingmakers.jpg" width="260" height="391" /></p>
<p>In a world powered by software, the developers who create that software — especially the <em>really good</em> ones — are increasingly the center of influence and power in business. That&#8217;s the core thesis of Stephen O&#8217;Grady&#8217;s brief-but-brilliant, 48-page book, <a href="http://thenewkingmakers.com"><strong>The New Kingmakers: How Developers Conquered the World</strong></a>.</p>
<p>This is highly relevant to marketers and <a href="http://chiefmartec.com/2010/04/rise-of-the-marketing-technologist/">marketing technologists</a>.</p>
<p>The genesis for Stephen&#8217;s book was the striking realization that as part of the democratization of technology in organizations — sometimes called the consumerization of IT — <strong>the CIO could be the last know</strong> which technologies were actually being used.</p>
<p>The most mainstream example, of course, are smartphones and the proliferation of bring-your-own-device (BYOD) trends — whether officially sanctioned or not. But such &#8220;shadow IT&#8221; has blossomed much further, with software-as-a-service (SaaS) applications that users adopt because they love them — not because they are mandated by IT. This is certainly the case with many popular <a href="http://chiefmartec.com/2012/09/marketing-technology-landscape-supergraphic-2012/">marketing technology</a> applications.</p>
<p>Stephen traces this revolution to the modern emancipation of software developers.</p>
<p>Not too long ago, software developers were beholden to the corporate hierarchy to perform their trade. Software was expensive. Hardware was expensive. Marketing and distribution of applications was expensive. So developers had to rely on sponsorship from executives with large purses. The balance of power was heavily weighted in the favor of those executives to decide what was going to be developed, on which platforms, and with which tools.</p>
<p>But four forces have converged to turn that model upside down:</p>
<p><strong>1. Open source software.</strong> Thanks to the explosion of the open source movement, a large number of software platforms and tools — operating systems, programming languages, web servers, databases, application frameworks, advanced science and math libraries, etc. — are now <em>free</em>. Not only are they free, but their source code is freely available too. If developers don&#8217;t like how a particular open source program works, they can modify it — and contribute that modification back to the community. Effectively, <em>they no longer need anyone&#8217;s sponsorship to use or deploy best-in-class software</em>.</p>
<p><strong>2. Cloud computing.</strong> The other half of the equation was hardware: those with the keys to expensive data centers still had control. But cloud-based platforms and infrastructures — Amazon Web Services (AWS) is the clear leader here — have made state-of-the-art hardware available, on-demand anywhere in the world, to anyone so cheaply that it might as well be free. &#8220;Anyone with a $10 bill can rent a 10-machine cluster with 1TB of distributed storage for 8 hours,&#8221; noted Flip Kromer, CTO of Infochimps. Heck, in some cases, it actually <a href="http://aws.amazon.com/free/"><em>is<em> free</em></em></a>. Now for hardware and world-class Internet infrastructure, developers no longer needed deep-pocketed sponsorship either.</p>
<p>With free software and nearly-free hardware, developers were liberated from oppressive cost structures.</p>
<p><strong>3. The connected economy.</strong> The Internet itself has broken down many of the remaining barriers to developers adopting and harnessing new platforms and tools. Blogs, online communities, Q&amp;A sites like <a href="http://stackoverflow.com">StackOverflow</a> enables developers to connect with each other and to learn and share knowledge without expensive training or the constraints of traditional publishing. Shared code repositories like <a href="https://github.com">GitHub</a> have made it cheap-or-free for developers to collaborate on projects around the world.</p>
<p>Even more powerful, however, has been the fact that the connected economy has provided a channel for developers to directly market software to users. Software-as-a-service is now accepted as the <em>de facto</em> delivery mechanism for applications — and it&#8217;s easy to scale cloud computing hardware as customer demand grows. Search marketing and social media marketing can be done on a shoestring budget, and a good product can gain an enormous boost through word-of-mouth. I&#8217;ve written before that <a href="http://chiefmartec.com/2012/05/engineers-are-becoming-a-lot-like-marketers-too"><strong>engineers are becoming very good marketers</strong></a> in their own way.</p>
<p><strong>4. Seed funding and crowd funding.</strong> Despite free or extremely low cost software, hardware, and marketing channels, developers who want to create a commercial application still have some other basic needs — food, water, shelter. Even though the economics of software development have been radically transformed, money is still needed to get a new venture off the ground. However, a new generation of investors have appeared to fulfill that need: seed stage investment funds, startup accelerators, angel investment groups, and crowd funding via services such as Kickstarter. (For a great crowd funding story, read how <a href="http://articles.latimes.com/2012/apr/18/business/la-fi-tn-pebble-smart-watch-kickstarter-20120418">the Pebble watch project raised $4.7 million on Kickstarter</a>.)</p>
<p>With these four forces, developers were suddenly in control of their own destiny.</p>
<p>At the same time, the world became digital — and software became the centerpiece of almost all business activities. See Marc Andreessen&#8217;s editorial in the Wall Street Journal: <a href="http://online.wsj.com/article/SB10001424053111903480904576512250915629460.html"><strong>Why Software Is Eating The World</strong></a>.</p>
<p>In that world, software developers, the modern day mystics who can read and write code, have become the most valuable players in almost every venture. And with their newfound freedom, they&#8217;re in a position to be extremely choosey about who they work for and how they work. Happy and inspired software developers can transform a company&#8217;s fortunes. Disaffected software developers can abandon a company to irrelevance.</p>
<p>As the cover image on Stephen&#8217;s book suggests: software developers, who used to be pawns in the great game of business, are now the new kingmakers.</p>
<p>For marketers, it&#8217;s incredibly important to recognize this dynamic because:</p>
<ul>
<li>The products we&#8217;re marketing are increasingly built under this new power structure.</li>
<li>The marketing technology applications we&#8217;re adopting are products of this dynamic.</li>
<li>Understanding this helps us grok the revolution underway in the IT department.</li>
<li>We&#8217;re trying to hire, harness, and retain our own marketing technologist developers.</li>
<li>This is indicative of a broader shift to bottom-up power in modern organizations.</li>
</ul>
<p>That last point connects to the growth of <a href="http://chiefmartec.com/2013/03/agile-marketing-for-a-world-of-constant-change/"><strong>agile marketing</strong></a>. It&#8217;s no coincidence that agile methodologies in software development have increased in popularity in conjunction with the shift of power to developers. With more power at the bottom of the organizational pyramid than ever before, the real competitive advantage will go to companies that are able to adapt their management and culture to take advantage of this bottom-up wellspring of capability.</p>
<p>The post <a href="http://chiefmartec.com/2013/05/the-new-kingmakers-are-a-rising-force-in-marketing-too/">The New Kingmakers are a rising force in marketing too</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/the-new-kingmakers-are-a-rising-force-in-marketing-too/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>5 ways to make stats in content marketing more credible</title>
		<link>http://chiefmartec.com/2013/05/5-ways-to-make-statistics-in-content-marketing-more-credible/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=5-ways-to-make-statistics-in-content-marketing-more-credible</link>
		<comments>http://chiefmartec.com/2013/05/5-ways-to-make-statistics-in-content-marketing-more-credible/#comments</comments>
		<pubDate>Thu, 02 May 2013 18:54:28 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Data]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=459</guid>
		<description><![CDATA[<p>As marketers, we want to be better consumers of data. Presented with data and its analysis, we want to be able to judge its accuracy and relevance to our decision making. We want to gauge its ambiguity and uncertainty, even though on the surface we&#8217;re being presented with quantified &#8220;facts.&#8221; We want to detect bias [...]</p><p>The post <a href="http://chiefmartec.com/2013/05/5-ways-to-make-statistics-in-content-marketing-more-credible/">5 ways to make stats in content marketing more credible</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-460" style="margin-top: 25px; margin-bottom: 25px;" alt="Suspicious Statistics in Content Marketing" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/dilbert-sampling.gif" width="600" height="205" /></p>
<p>As marketers, we want to be better consumers of data. Presented with data and its analysis, we want to be able to judge its accuracy and relevance to our decision making. We want to gauge its ambiguity and uncertainty, even though on the surface we&#8217;re being presented with quantified &#8220;facts.&#8221; We want to detect bias and account for it.</p>
<p>So let&#8217;s start with our own statistics in content marketing.</p>
<p>Because, seriously, <strong>too many of the stats that are appearing in content marketing these days smell fishy</strong>. I don&#8217;t want to pick on anyone in particular — there are too many folks doing this to unfairly single out one — so I&#8217;ll give you a hypothetical example:</p>
<p style="padding-left: 30px;"><em>Company X reports that their latest state-of-the-industry survey reveals 72% of marketers are engaging in — or plan to engage in — hamster optimization. Clearly hamster optimization is big! And isn&#8217;t that great, because coincidentally Company X just happens to be a hamster optimization provider&#8230;</em></p>
<p>You&#8217;ve certainly see examples like that. Some are blatantly biased. Others are a little more subtle. But the <a href="http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/"><strong>content marketing arms race</strong></a> has fueled the fire for many newsworthy-but-questionably-justified kinds of claims like these.</p>
<p>Now, being biased is not necessarily a terrible thing — as long as you disclose your bias and don&#8217;t try to sweep it under the rug. Qualify the data on which your statistics are based, so that readers can make a fair assessment of the context and relevance of your findings. After all, you presumably want your readers to trust you. That&#8217;s kind of the bigger brand mission with your content marketing in the first place, right?</p>
<h3>5 ways to make your statistics more authentic</h3>
<p>There are five things you can — and should — do when presenting survey statistics:</p>
<ol>
<li>Note the sample size — how many people participated.</li>
<li>Break down the basic firmographics of the participants.</li>
<li>Describe how the participants were selected.</li>
<li>Include the original question and answer choices.</li>
<li>Define nomenclature that may be highly subject to interpretation.</li>
</ol>
<p>The first, <strong>noting sample size</strong>, most people already do. If you don&#8217;t, start now because it&#8217;s an immediate red flag if it&#8217;s not stated — and because <em>n = 20</em> is very different than <em>n = 2,000</em>. Conclusions drawn from small samples are weaker than those from large samples. And while there may still be value in sharing results from undersized samples, the value is more anecdotal than statistical. Play fair and let people know that.</p>
<p>How large should your sample size be — how big should <em>n</em> be? It depends on some slightly technical parameters such as confidence level and confidence interval. But here&#8217;s a simple <a href="http://www.raosoft.com/samplesize.html"><strong>sample size calculator</strong></a> you can use with some basic examples to put you in the ballpark.</p>
<p>The second, <strong>breaking down the basic firmographics of participants</strong>, is unfortunately less common. Firmographics are things such as the size of participants&#8217; companies in revenue or employees, their geographic region, their industry, whether they&#8217;re B2B or B2C, etc. You may also consider including the level of the participants — mid-level managers, senior directors, top executives, etc.</p>
<p>You don&#8217;t have to go overboard, but even a little bit of this information goes a long way towards qualifying your results. If all your participants were mid-level managers from enterprises with $100 million or more in revenue, that&#8217;s probably a very different story than if your data comes from top executives at small businesses with less than 50 employees.</p>
<p>The third, <strong>describing how participants were selected</strong>, is the difference between the amateurs and the pros. Any professional research will disclose how the participants were found, enticed, and qualified, usually under the heading &#8220;methodology.&#8221; Here&#8217;s an example from a report on business analytics by Harvard Business Review and SAS:</p>
<p><img class="alignnone size-full wp-image-461" alt="Sample Methodology Section" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/05/hbs_methodology_sample.png" width="600" height="171" /></p>
<p>This is super important because <a href="http://en.wikipedia.org/wiki/Selection_bias"><strong>selection bias</strong></a> — a set of characteristics or circumstances that influenced the selection of participants — can profoundly skew the results of a study.</p>
<p>For example, let&#8217;s go back to our hypothetical hamster optimization provider, Company X. For their survey, they reach out to their blog subscribers, Twitter followers, and Facebook fans to participate. It should come as no surprise that a sample of that population — people who follow Company X — would have pretty positive views on hamster optimization. (&#8220;Hamster optimization rules!&#8221;)</p>
<p>The results would likely be quite different if Company X invited participants from a random set of <em>Harvard Business Review</em> subscribers. (&#8220;What the heck is hamster optimization?&#8221;)</p>
<p>To be honest, selection bias is almost impossible to avoid — especially in industry studies with modest budgets, which is usually the case in guerrilla content marketing. That&#8217;s okay. Just disclose your selection methodology so that readers can adjust their interpretation with that bias in mind.</p>
<p>For Company X to pull participants mostly from its own universe, but to report <em>as if</em> their findings represent a more general population, however, would be disingenuous.</p>
<p>If you fear that disclosing your selection methodology could undermine the results of your study — that should be a warning bell — then you might consider ponying up money to find a less biased population to sample. This is one of the services that professional industry analyst firms offer. They&#8217;re not free from selection bias either, of course, but their audiences are usually much less biased than the ecosystem around a single vendor.</p>
<p>The fourth, <strong>including the original question and answer choices</strong>, helps make sure that you, your survey participants, and your content consumers are all talking about the same thing.</p>
<p>If you ask a question like, &#8220;Do you use data-driven decision making?&#8221; and get Y% who respond &#8220;yes&#8221; — but then in your report you write, &#8220;Y% are data-driven decision makers&#8221; — you&#8217;re changing the meaning. Participants may have answered the question thinking that they occasionally use data-driven decision making <em>along with other experience-driven approaches</em>. But the statement in your report could be interpreted that those participants <em>predominantly or exclusively</em> use data-driven decision making.</p>
<p>This effect can be subtle or significant. But it&#8217;s easy to avoid problems by simply restating the question and answers verbatim. You can add other narrative around that, but <strong>you&#8217;re clear about what&#8217;s data and what&#8217;s narrative</strong>.</p>
<p>Finally, <strong>defining nomenclature that may be highly subject to interpretation</strong>, in both the survey and the report, avoids misinterpretations. For instance, if you&#8217;re surveying how many marketing teams have a &#8220;marketing technologist&#8221; on staff, you might want to define who qualifies as a marketing technologist. An IT person working in marketing? A web developer? A marketing automation specialist? Depending on the definition, you may get very different results.</p>
<p>Particularly with so many new terms popping up in our profession, including brief definitions in your study can help reduce the risk of wildly different interpretations impacting the accuracy of your analysis.</p>
<p>This certainly isn&#8217;t an exhaustive list of survey and statistical analysis dos and don&#8217;ts. But if we could raise the bar on survey-driven content marketing to address these five issues, it would make that content more valuable than a quick flurry of soundbite tweets on Twitter — it would provide information that our readers could actually use in more data-driven decision making.</p>
<p>And it would make you a more credible source in the eyes of your audience — as all good content marketing should.</p>
<p>The post <a href="http://chiefmartec.com/2013/05/5-ways-to-make-statistics-in-content-marketing-more-credible/">5 ways to make stats in content marketing more credible</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/05/5-ways-to-make-statistics-in-content-marketing-more-credible/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>Marketing technologists and growth hackers, oh my</title>
		<link>http://chiefmartec.com/2013/04/marketing-technologists-and-growth-hackers-oh-my/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=marketing-technologists-and-growth-hackers-oh-my</link>
		<comments>http://chiefmartec.com/2013/04/marketing-technologists-and-growth-hackers-oh-my/#comments</comments>
		<pubDate>Tue, 30 Apr 2013 12:32:37 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Management]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=457</guid>
		<description><![CDATA[<p>The terms &#8220;marketing technologist&#8221; and &#8220;growth hacker&#8221; seem to be gaining traction out there. Voice-based marketing automation provider ifbyphone recently released their annual State of Marketing Measurement Survey for 2013, which included the following results on the evolution of the marketing team: 31% have a marketing technologist 25% have a growth hacker Marketing automation is [...]</p><p>The post <a href="http://chiefmartec.com/2013/04/marketing-technologists-and-growth-hackers-oh-my/">Marketing technologists and growth hackers, oh my</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-456" alt="Roles on the Marketing Team" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/marketing_team_ibp_600.png" width="600" height="303" /></p>
<p>The terms &#8220;marketing technologist&#8221; and &#8220;growth hacker&#8221; seem to be gaining traction out there.</p>
<p>Voice-based marketing automation provider ifbyphone recently released their annual <a href="http://public.ifbyphone.com/press_releases/ifbyphone-survey-reports-marketing-measurement-trends-bigger-budgets-more-ceo-scrutiny-emerging-measurement-technologies-to-drive-marketing-roi/"><strong>State of Marketing Measurement Survey</strong></a> for 2013, which included the following results on the evolution of the marketing team:</p>
<ul>
<li>31% have a marketing technologist</li>
<li>25% have a growth hacker</li>
<li>Marketing automation is used more frequently by teams with growth hackers (44%) than teams without growth hackers (26%)</li>
</ul>
<p>Ifbyphone defines a marketing technologist as &#8220;a marketer with significant IT skills.&#8221; They define a growth hacker as &#8220;a marketer who combines marketing knowledge with a strong technical background to drive growth.&#8221;</p>
<p>The survey was conducted online earlier this year with more than 400 respondents across the U.S. who are responsible for marketing within their company. Unfortunately, more detailed firmographics of the participants were not provided, so it&#8217;s hard to draw more specific conclusions about the kinds of organizations this data represents (size, industry, B2B vs. B2C, etc.). My guess is that they&#8217;re probably mostly smaller firms, since only 1/4 report having a product manager, which is a fairly common role at larger organizations. <em>(Interesting note: for this population, marketing technologists are more common than product managers.)</em></p>
<p>It also makes it hard to compare against Gartner&#8217;s claim that <a href="http://chiefmartec.com/2013/03/gartner-confirms-rise-of-the-chief-marketing-technologist/">70% of companies have a chief marketing technologist role</a> — especially since Gartner didn&#8217;t publicly provide firmographics of the participants in their survey either.</p>
<p>Hey, marketers and analysts — I <em>love</em> all this research data that is being published in the name of content marketing, but a little more detail on the participants would make this information much more useful, credible, actionable.</p>
<p>Just another humble vote for <a href="http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/">pragmatic marketing</a>.</p>
<p>But I digress! The one solid conclusion I can draw is that the terms marketing technologist and growth hacker are appearing in more marketing industry surveys and a good number of participants in those surveys report that they&#8217;ve adopted those roles in their teams.</p>
<p>It&#8217;s a qualitative conclusion, but a good one.</p>
<p><strong>UPDATE</strong>: Someone pointed me to the Gartner webinar where they did share some of the firmographics of the participants in their research that weren&#8217;t included in the original press release. In regard to the 70% of firms that have a chief marketing technologist role, those were based on 203 respondents from U.S. firms with $500 million or more in revenue. It was a pretty even mix of B2B and B2C companies across a number of different verticals. In their question, they defined a chief marketing technologist role as &#8220;the equivalent of a CTO and CIO dedicated to marketing, familiar with all kinds of marketing software, data &amp; analytics, social &amp; mobile platforms, content marketing, web mechanics, digital advertising networks, among other topics.&#8221;</p>
<p>The post <a href="http://chiefmartec.com/2013/04/marketing-technologists-and-growth-hackers-oh-my/">Marketing technologists and growth hackers, oh my</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/04/marketing-technologists-and-growth-hackers-oh-my/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Pragmatic marketing vs. hype cycles and false dilemmas</title>
		<link>http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=pragmatic-marketing-vs-hype-cycles-and-false-dilemmas</link>
		<comments>http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/#comments</comments>
		<pubDate>Sat, 27 Apr 2013 11:23:49 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Management]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=453</guid>
		<description><![CDATA[<p>Darling, I don&#8217;t know why I go to extremes Too high or too low there ain&#8217;t no in-betweens — Billy Joel There&#8217;s a common fallacy known as a false dilemma or false dichotomy. It&#8217;s where you&#8217;re artificially presented with a black-and-white, either-or choice: you&#8217;re forced to choose between all of one or all of the [...]</p><p>The post <a href="http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/">Pragmatic marketing vs. hype cycles and false dilemmas</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<blockquote><p>Darling, I don&#8217;t know why I go to extremes<br />
Too high or too low there ain&#8217;t no in-betweens<br />
— Billy Joel</p></blockquote>
<p>There&#8217;s a common fallacy known as a <a href="http://en.wikipedia.org/wiki/False_dilemma">false dilemma</a> or false dichotomy. It&#8217;s where you&#8217;re artificially presented with a black-and-white, either-or choice: you&#8217;re forced to choose between all of one or all of the other. &#8220;You&#8217;re either with us or against us!&#8221;</p>
<p>It&#8217;s a fallacy because, most of the time, you&#8217;re not actually constrained to just those two choices. There are many great options in the middle — and often even more outside of that narrowly framed continuum.</p>
<p>In modern marketing, however, I&#8217;ve been noticing that more and more issues are being framed as black-and-white, either-or choices. We seem more ready than ever to take a new idea and either reject it completely or embrace it to the point of absurdity. The &#8220;reasonable middle&#8221; seems to get relatively little voice, even though <strong>in most cases, a balanced approach is optimal</strong>.</p>
<p><img class="alignnone size-full wp-image-442" alt="Moderation in Marketing Memes" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/kool-aid_consumed_600.png" width="600" height="344" /></p>
<p>Consider these examples, topics that generate much debate at the extremes but in actuality benefit from a healthy dose of moderation:</p>
<p><strong>Inbound marketing.</strong> Inbound marketing (and permission marketing before it) is the native son of the Internet: using good content marketing, organic SEO, social media marketing, and subsequent email-driven nurturing to win customers by fulfilling their quest for knowledge is an incredibly powerful paradigm. Outbound marketing, such as advertising, direct mail, sponsorships, event exhibits, sales calls, and other mainstays of traditional marketing, is on the other end of the spectrum. But while these are very different approaches, however, there&#8217;s no reason why a company shouldn&#8217;t do both — each to the degree that they provide ROI and have a positive brand impact. There are even a plethora of hybrid tactics, such as pay-per-click (PPC) advertising in search and social media.</p>
<p><a href="http://chiefmartec.com/2013/01/the-big-data-bubble-in-marketing/"><strong>Data-driven marketing.</strong></a> Relying solely on gut-based, experience-driven decision-making in marketing is foolish in the digital age. It&#8217;s so easy to leverage analytics and experimentation to make better decisions. But going overboard, believing that data has <em>all</em> the answers — what Kate Crawford has labeled <a href="'http://blogs.hbr.org/cs/2013/04/the_hidden_biases_in_big_data.html&quot;"><strong>data fundamentalism</strong></a> — may be even worse than ignoring data entirely. Data fundamentalism allows you to make incredibly stupid decisions with a high degree of statistical confidence. Again, the sensible answer for most companies is a balance of data analytics and human judgement.</p>
<p><strong>Marketing technology governance.</strong> Should marketing leave all technology strategy and management to the IT department? In the digital world, probably not. But does that mean that marketing has to become 100% compartmentalized in all technology it uses? Of course not. There are many reasonable compromises and collaborations between those two poles, where marketing teams develop native technical leadership capabilities while also partnering and coordinating with IT. A <a href="http://chiefmartec.com/2010/04/rise-of-the-marketing-technologist/">chief marketing technologist</a> can be the bridge between marketing and IT, not a crocodile in the moat.</p>
<p><a href="http://chiefmartec.com/2013/03/agile-marketing-for-a-world-of-constant-change/"><strong>Agile marketing.</strong></a> Traditional management approaches are often top-down, strict command-and-control hierarchies. But in our digitally malleable and rapidly shifting world, such corporate structures struggle to adapt to ever more fluid markets. Agile management approaches, which give a lot of power to bottom-up creativity and talent, are much better suited to this environment. But for most companies, the optimal approach will be a combination of the two. The best agile organizations naturally blend consistent top-down vision and values with bottom-up imagination and insight.</p>
<p>In all these scenarios, it&#8217;s <em>not</em> a strict either/or proposition.</p>
<p>You can do great inbound marketing <em>and</em> great outbound marketing. You can embrace data-driven decision making <em>and</em> apply human reasoning and the insights of experience. You can collaborate with IT <em>and</em> have your own marketing technology responsibilities. You can have strong top-down leadership <em>and</em> adopt agile marketing for the parts of your marketing mission that benefit from it.</p>
<p>So why don&#8217;t these more balanced approaches get more attention?</p>
<h3>Hype cycles, maturity models, and other self-inflicted wounds</h3>
<p>I believe there are 7 reasons why the extremes in modern marketing get more air time than they deserve — and by calling them out, I hope it will make it easier to keep them in check:</p>
<ol>
<li>Gartner&#8217;s hype cycle.</li>
<li>A mental bias for either-or decisions.</li>
<li>Maturity models.</li>
<li>Up-and-to-the-right graphs.</li>
<li>Conflating advocacy with absolutism.</li>
<li>False trade-offs — e.g., art/science is not really a trade off.</li>
<li>Content marketing escalation.</li>
</ol>
<p><img class="alignright size-medium wp-image-444" alt="Gartner Hype Cycle" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/Gartner_Hype_Cycle-300x195.png" width="300" height="195" /></p>
<p>The first is Gartner&#8217;s <a href="http://en.wikipedia.org/wiki/Hype_cycle"><strong>hype cycle</strong></a>. Marketing actually <em>created</em> the hype cycle, perfecting the art of sensationalizing new technologies to generate buzz, news clippings, and higher valuations. But the peak of inflated expectations — overpromising and underdelivering — inevitably leads to the trough of disillusionment. Many companies (and careers within them) are damaged by this precipitous fall.</p>
<p>The irony is that marketing is now a victim of its own hype cycle dynamics. These days, it&#8217;s the marketer who is the <em>target</em> of the hype. The hype for new social media platforms, the hype for big data, the hype for new marketing technologies, etc. And the rate of new cycles being thrown at marketers is now so rapid that, even as they each run their course, most CMOs are being pulled up at least two or three peaks of inflated expectations at any point in time.</p>
<p>But here&#8217;s the thing: <strong>a hype cycle can only seduce you if you let it</strong>. You don&#8217;t have to flat out ignore a new technology either. You can take a modest position of skeptical curiosity and a willingness to test the practical uses of something new.</p>
<p>In Chip and Dan Heath&#8217;s new book, <a href="http://www.amazon.com/Decisive-Make-Better-Choices-Life/dp/0307956393"><strong>Decisive</strong></a>, they call attention to a number of psychological quirks in our decision-making instincts. One of them is <strong>our tendency to get trapped in narrow frames</strong> — such as either-or decisions. This is the false dilemma fallacy.</p>
<p>However, by recognizing this bias, we can consciously broaden the frame of our decision, considering &#8220;and&#8221; instead of &#8220;or&#8221; — or exploring entirely different options.</p>
<p><img class="alignright size-medium wp-image-445" alt="Maturity Models" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/Characteristics_of_Capability_Maturity_Model-300x225.png" width="300" height="225" /></p>
<p>Another culprit of overreaching expectations is the <strong>maturity model</strong>. No doubt, you&#8217;ve seen these: four or five stages that organizations progress through — or supposedly <em>should</em> progress through — in developing a certain capability along a number of dimensions. One of the original maturity models was for software development, <a href="http://en.wikipedia.org/wiki/Capability_Maturity_Model">CMM</a> (Capability Maturity Model). Since then, there have been an explosion of maturity models, from big data to social media. Even I&#8217;m guilty of producing one, a <a href="http://ioninteractive.com/post-click-marketing-blog/2008/10/16/search-marketing-maturity-model-draft.html">search marketing maturity model</a> five years ago. (Has the statute of limitations expired?)</p>
<p>The problem is that each stage typically promotes advancement on all dimensions of the model — pushing every aspect of the company&#8217;s &#8220;maturity&#8221; further and further into the stratosphere. The implicit assumption is that you should always want to move up to the next stage.</p>
<p>But that may not be the right thing to do. There is a cost to everything, and advancing into the highest levels of a maturity model may have <a href="http://en.wikipedia.org/wiki/Diminishing_returns">diminishing returns</a> or even negative returns for you. For instance, with that original maturity model for software, CMM, it has been observed that many of the world&#8217;s leading software companies — Apple, Microsoft, Symantec — never advanced beyond the first or second stage.</p>
<p>Real maturity is discovering which stage is optimal for your business, or even mixing attributes from different stages — resisting the narrow-framing of a fixed set of homogenized stages (that were likely assembled by someone with their own marketing agenda).</p>
<p>A more generic version of maturity model madness is the <strong>up-and-to-the-right graph</strong>. So many promotional materials emphasize up-and-to-the-right graphs: do more of X, get more of Y. And who doesn&#8217;t want <em>more</em>? More clicks, more leads, more customers, more revenue, more profit, more, more, more.</p>
<p>Which is great — but again, everything has a cost, even if it&#8217;s just opportunity cost. The pursuit of &#8220;more&#8221; without considering what those costs are leads to absurdity. <em>If one blog post a week gets us 10 prospects, and one blog post a day gets us 20 prospects, then we should publish a blog post every second to take over the world!</em> Just because the line on the graph can go higher and further to the right doesn&#8217;t necessarily mean you should chase it there — at the expense of other variables that aren&#8217;t represented on that graph.</p>
<p>The antidote: common sense and more holistic cost/benefit thinking.</p>
<p><strong>Conflating advocacy with absolutism</strong> happens when we&#8217;re excited and passionate about something that is clearly good, but we slide from merely embracing it to <em>embracing it at the exclusion of other things</em>. Other things that didn&#8217;t need to be excluded. For instance, data-driven decision making is a wonderful thing. Use data as much as you can. But that doesn&#8217;t have to be at the exclusion of leveraging experience, intuition, and human judgement — especially in deciding what data to use and in recognizing what&#8217;s reasonable to extrapolate from it.</p>
<p>Related to that is the notion of a <strong>false trade-off</strong>, taking two things and erroneously claiming that there is an inverse relationship between them — that more of one inherently means less of the other. The example I&#8217;m thinking of is the debate between art and science in marketing. It&#8217;s implied that more science means less art. But that&#8217;s certainly not true in the real world: more physics does not mean less poetry.</p>
<p>Of course, in the context marketing, &#8220;art&#8221; is often meant as more qualitative and intuitive factors, in contrast to &#8220;science&#8221; as more quantitative and analytical factors. Storytelling through written, spoken, and visual expressions is also considered &#8220;art&#8221; in marketing (although it&#8217;s really more of a craft). Whereas analytics, data mining, and controlled experiments such as A/B testing are considered more &#8220;science.&#8221;</p>
<p>But still, even with those fuzzy definitions, modern marketing can — and should — synthesize methods from both the &#8220;art&#8221; and the &#8220;science&#8221; categories. They&#8217;re not necessarily trade-offs. Great science in marketing can direct the application of great art in marketing, and vice versa — for instance, there&#8217;s an art to running great marketing experiments, if you can wrap your head around that juxtaposition. And let&#8217;s not forget that <a href="http://chiefmartec.com/2008/03/marketing-as-a/"><strong>science itself is a creative endeavor</strong></a>.</p>
<p>Last but not least, <strong>content marketing escalation</strong>. There&#8217;s a heated content marketing arms race underway. Marketers are being pushed to generate more and more content, faster and faster. But there are two deleterious &#8220;hype cycle&#8221; side effects of this.</p>
<p>First, topics that seem to be trending are rapidly added to content marketing agendas. <em>Quick, we need a white paper on something with big data!</em> This causes an acceleration of content on a topic that can make it seem even hotter, which attracts the attention of more content marketers, and so on, like feedback from a microphone next to an amplifier. In the interest of speed-to-publish, not all of these content pieces are, um, deep or original. Let&#8217;s just say that there are a lot of echoes in the shallow end of the pool. But those echoes don&#8217;t offer independent corroborating evidence of that trend.</p>
<p>Second, because there is suddenly a <em>flood</em> of content on that new subject, everyone is vying for attention in a crowded field. This can create pressure to produce something that has &#8220;shock value&#8221; — something surprising or controversial. Such things are often found on the edges of a continuum rather than in the middle, which can artificially skew the perception of the edges being greater than the middle.</p>
<p>Moderate and nuanced articles and reports don&#8217;t necessarily make for &#8220;sexy&#8221; content marketing. But I personally believe that more pragmatic content can be more <em>useful</em> to real prospects. In an environment where we marketers are the consumers of content marketing, not just producers, we can influence this dynamic. We can seek out the real over the sensational and use social signals (or the absence of them) to give our fellow marketers clear feedback on what we really want.</p>
<p>(To be fair, certainly a number of marketers do set a high bar for their content marketing. But as a group, they&#8217;re probably at least one standard deviation above the mean. Maybe two.)</p>
<h3>Pragmatic marketing is marketing in a Technicolor world</h3>
<blockquote><p>The test of a first-rate intelligence is the ability to hold two opposing ideas in mind at the same time and still retain the ability to function.<br />
— F. Scott Fitzgerald</p></blockquote>
<p>I&#8217;ve <a href="http://chiefmartec.com/2012/12/5-marketing-meta-trends-the-presentation/">said it many times</a>: it&#8217;s an exciting but challenging time in marketing. We&#8217;re in a period of enormous disruptive innovation, an intellectual and creative melting pot of old and new strategies, tactics, capabilities, and worldviews.</p>
<p><strong>The last thing a marketer should do these days is resist change.</strong></p>
<p>In fact, I believe that most marketers should lean into an &#8220;early adopter&#8221; mindset. Be willing to learn about and experiment with new ideas as they emerge. This is important not because those new ideas will bear fruit immediately — some will, some won&#8217;t, and probably none of them to the degree that their initial streak up the hype cycle might proclaim — but because engaging on the vanguard of such changes helps marketing be more attune to broader shifts in markets and society.</p>
<p>Marketing should be the &#8220;early warning&#8221; signal for changes that will effect the business. Since adapting to change is probably the most challenging thing for any organization to do, having a head start on a new trend, gaining some early experience and familiarity with it, lays the groundwork to more rapidly embrace that trend at scale — if and when that&#8217;s warranted.</p>
<p>Not every trend will blossom. Many will fizzle out. But placing little bets on a number of emerging opportunities lets you hedge against both possible outcomes. Even those that don&#8217;t take off can provide some valuable insight into how the world is evolving. Marketers must stay hungry to understand their customers — and that&#8217;s always a moving target.</p>
<p>And by continually scouting the frontier and experimenting with new ideas, marketing increases its overall metabolism for change. <em>That</em> is a precious capability in a world of constant and accelerating change. It&#8217;s part of <a href="http://chiefmartec.com/2012/11/why-marketing-may-solve-the-innovators-dilemma/"><strong>why I believe marketing, more than any other group, has the potential to break free from the innovator&#8217;s dilemma</strong></a>.</p>
<p>So am I advocating two contradictory principles here?</p>
<ol>
<li>Don&#8217;t fall prey to the inflated hyperbole of new ideas.</li>
<li>Embrace new ideas with the mindset of an early adopter.</li>
</ol>
<p>Is this a paradox?</p>
<p>I don&#8217;t believe it has to be. We can take the pragmatic approach of balancing both in some reasonable proportion to each other. Granted, that denies us the simplicity of black-or-white positions and deflates the false dilemmas that give rise to so many sexy blog post titles.</p>
<p>But it leaves us with the far more interesting challenge of painting marketing in a vibrant Technicolor world.</p>
<p>The post <a href="http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/">Pragmatic marketing vs. hype cycles and false dilemmas</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/04/pragmatic-marketing-vs-hype-cycles-and-false-dilemmas/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Advice from a Jedi Knight of marketing experimentation</title>
		<link>http://chiefmartec.com/2013/04/advice-from-a-jedi-knight-of-marketing-experimentation/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=advice-from-a-jedi-knight-of-marketing-experimentation</link>
		<comments>http://chiefmartec.com/2013/04/advice-from-a-jedi-knight-of-marketing-experimentation/#comments</comments>
		<pubDate>Thu, 25 Apr 2013 11:47:09 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Data]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=450</guid>
		<description><![CDATA[<p>A couple of months ago, I wrote a column on Search Engine Land titled Why Big Testing Will Be Bigger Than Big Data. A shorter spin-off of my post here on the big data bubble in marketing, its overarching message was that in a world of ever more data, experimentation would inevitably become king. The [...]</p><p>The post <a href="http://chiefmartec.com/2013/04/advice-from-a-jedi-knight-of-marketing-experimentation/">Advice from a Jedi Knight of marketing experimentation</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="alignnone size-full wp-image-449" style="margin-top: 25px; margin-bottom: 25px;" alt="Marketing Experimentation Advice" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/marketing_experimentation_advice.jpg" width="600" height="320" /></p>
<p>A couple of months ago, I wrote a column on Search Engine Land titled <a href="http://searchengineland.com/why-big-testing-will-be-bigger-than-big-data-145452"><strong>Why Big Testing Will Be Bigger Than Big Data</strong></a>. A shorter spin-off of my post here on <a href="http://chiefmartec.com/2013/01/the-big-data-bubble-in-marketing/">the big data bubble in marketing</a>, its overarching message was that in a world of ever more data, experimentation would inevitably become king.</p>
<p>The message seemed to resonate, and the article was widely shared. However, my suggestion that the number of people empowered to run experiments should be significantly expanded in most organizations raised a number of questions in the comments. <em>How do you build and scale a testing culture in a company?</em></p>
<p><img class="alignright size-full wp-image-447" alt="Andy Pulkstenis" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/andy_pulkstenis.jpg" width="100" height="100" /></p>
<p>The column and those questions caught the attention of Andy Pulkstenis, whom I would describe as a Jedi Knight of experimental design. He&#8217;s had years of experience running marketing-oriented controlled experiments at Capital One — one of the world&#8217;s pioneers in large-scale marketing experimentation programs — and now at State Farm.</p>
<p>Andy&#8217;s an enthusiastic champion of developing a &#8220;testing culture,&#8221; and he gave <a href="http://blogs.sas.com/content/subconsciousmusings/2012/10/12/is-experimental-design-the-red-headed-stepchild-of-modeling/">a popular presentation on the subject at SAS&#8217;s Analytics 2012 conference last year</a>. He and I had the opportunity to chat, and he agreed to participate in the following Q&amp;A on testing on the big stage. All the graphics in this post were created by him.</p>
<p><strong>Can you start by telling us a little bit about your background and your role at State Farm?</strong></p>
<p>I have an MS in Statistics from Penn State, and have been working in applied business analytics and predictive modeling for about 18 years now. I spent 8 years working for a firm that did statistical consulting and a lot of SAS, then spent 6 years at Capital One leading statistical analytic teams in a variety of departments. I&#8217;ve been at State Farm doing the same thing for the past 4 years.</p>
<p>I dabbled in testing off and on before Capital One, but it was there that I feel I <em>really</em> learned how to do testing. I was fortunate to work directly with a few mentors who had significant experience in testing and DOE and really knew the math behind the machinery as well. Bill Kahn and Tom Kirchoff were instrumental in my development as an experimenter.</p>
<p><strong>What are your arguments for why marketers should engage in testing, specifically controlled experiments?</strong></p>
<p>There are several. But the most basic is that if you are not testing, you never really know what&#8217;s driving customer behavior.</p>
<blockquote><p>If you are not testing, you never really know <strong>what&#8217;s driving customer behavior</strong>.</p></blockquote>
<p>In response to a business partner proclaiming what they believed to be truth about customer behavior, one of my colleagues said, &#8220;Do you know, or do you just <em>think</em> you know?&#8221; I&#8217;ve stolen that mantra and use it often in my own business discussions. When push comes to shove, observational data (data that did <em>not</em> come from randomized, controlled experiments) generates theories about what may be happening, but to really <em>know</em> causation with certainty requires a controlled experiment.</p>
<p>I sat in a talk a while back where the lecturer discussed observational studies — you know the ones, where they announce on TV that coffee or wine or whatever is bad for you, then the newspaper the next day says a study showed it&#8217;s good for you, then next month the same newspaper runs a contradictory story. He said that a group took dozens of observational studies, replicated each one in a controlled experimental environment, and in a whopping 80% of cases failed to reach the same conclusion as the uncontrolled observational study.</p>
<p>80%!</p>
<p>That should send chills down the spine of any business or marketing analyst when you consider that the vast majority of what passes for business analysis today is essentially an uncontrolled, observational data study, since 95% of the data in any large company is uncontrolled observational data. Clean data from an experiment gives clean answers, and if the sample is chosen properly the data can be used as the foundation for spectacular predictive models going forward.</p>
<blockquote><p>The vast majority of what passes for business analysis today is essentially <strong>an uncontrolled, observational data study</strong>.</p></blockquote>
<p>A related question that comes up often is &#8220;Why multivariate testing instead of A/B testing?&#8221; I think both have their place, but a firm that stops with simple A/B testing is really limiting potential for growth. In an A/B testing direct mail setting, for example, you learn which letter generated higher response, but you don&#8217;t learn why it worked because there were too many simultaneous differences between the letters.</p>
<p>Some practitioners try to mitigate that by OFAT (One Factor At a Time) testing — changing only one feature between the letters in the first A/B test, pick the winner, then change only a second feature in a second A/B test, combine that with the learnings from the first, etc., but this also has significant drawbacks (the most obvious is longer time to a decision).</p>
<p>A more detrimental drawback is that to combine conclusions across tests from different time periods makes some pretty bold assumptions about the lack of interactions, the lack of seasonality, and the lack of impact from exogenous factors like the economy or competitive environment. We demonstrated this for partners at State Farm using our internal data, from a real experiment, showing that the combined solution was actually the worst choice of overall strategy. (See graphic below.)</p>
<p><img class="alignnone size-full wp-image-448" alt="A/B Tests Combined" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/ab_tests_combined.jpg" width="600" height="315" /></p>
<p><strong>How can a marketer champion testing in their organization?</strong></p>
<p>You need to be a teacher and be willing to proactively sell this idea to anyone and everyone that will listen. I did that for about 2 months (and many audiences) before finding a willing business partner to try this &#8220;new&#8221; idea. They all liked the idea, but it took a while to find someone willing to go first.</p>
<p>Initially it&#8217;s about educating on the advantages of testing compared to observational analysis, sharing examples on how other firms are using it to improve business strategies, and I found value in answering some common arguments I&#8217;ve encountered right there in the first presentation, such as &#8220;it&#8217;s too expensive&#8221; or &#8220;it seems too complicated compared to what we do today.&#8221; I go down the list of about a dozen of them, and answer each one by one. This addresses 95% of the concerns in most groups before you even get to Q&amp;A.</p>
<blockquote><p>Initially it&#8217;s about educating on <strong>the advantages of testing</strong> compared to observational analysis.</p></blockquote>
<p><strong>How do you win executive-level buy-in?</strong></p>
<p>Conceptual buy-in is easy, but commitment to let you do this with a real business strategy can be another thing entirely.</p>
<p>Getting the right initial internal example is really important. If it&#8217;s too small, people don&#8217;t notice and it doesn&#8217;t really feel compelling. If it&#8217;s too big and errors occur, it becomes a high profile example people can latch onto for why we may <em>not</em> want to do testing. So aiming for an example of moderate impact but smaller and very manageable scope has worked for me. That opens doors to larger opportunities once the internal proof of concept is out there.</p>
<p>Telling people how other companies are improving business results through testing is helpful, but it&#8217;s very powerful when you can switch to telling people how other business units in your own firm have used testing to improve business results. Our first &#8220;big&#8221; multivariate test was 24 strategies, which felt ambitious at the time. Our follow-up in that same business area was over 200.</p>
<p><strong>From your experience, what are the ingredients that make for a successful testing project?</strong></p>
<p>1) The right SME&#8217;s representing the following 4 areas: The business, statistical design, implementation, and creative design (the guys making the marketing piece or web page, for example). Leaving any one of those 4 out causes many problems. Drop implementation, and the other guys create a great test that will crash our system. Drop the stats guy and the others can create a great test that doesn&#8217;t actually answer the questions accurately. Drop the business guy and the others create a great test that answers questions no one is asking, etc.</p>
<blockquote><p>Drop the business guy and the others create <strong>a great test that answers questions no one is asking</strong>.</p></blockquote>
<p>2) Monitoring, monitoring, monitoring! The work doesn&#8217;t end when it goes to implementation. There must be close monitoring of the test from start to finish, because you&#8217;d be surprised how many times someone makes a decision to &#8220;help out&#8221; that can destroy the statistical integrity of the test.</p>
<p>We had one web test where we needed to battle someone in implementation who believed that if someone visits the page, leaves, and comes back, we should continue to randomize which page he sees (versus fixing it to be the originally randomized page for all return visits for that guy). This, of course, completely destroys the ability to interpret the test factors because now they are all jumbled together. Was the response due to page 1? Page 2? The 3rd page he saw? A combination of all 3? We caught this in post-implementation monitoring and were able to correct it early on, only losing a couple of days.</p>
<p>3) Have a clear analysis plan before the test is even designed, including approach and metrics of interest. The analysis plan and statistical design are linked, and ignoring the analysis plan can lead to a design that doesn&#8217;t allow you to carry out the analysis as intended.</p>
<p>For example, you may intend to study interactions, but the design may assume no interactions exist. You usually can&#8217;t fix something like that on the back end. Maybe you plan to analyze the data at the customer-level, but the implementation platform produces only aggregate data. Best to get this stuff straightened out in the beginning so there are no surprises on the back end.</p>
<p><strong>As you scale up testing in an organization, how can you manage the process to avoid conflicts, such as one test interfering with another?</strong></p>
<p>We&#8217;re currently tackling this challenge. It can be helpful to start first with a siloed prioritization approach, within each channel or business line, for example. When the same stakeholders are the ones causing the problems, it&#8217;s easier to resolve. We&#8217;ve got that handled pretty well in our firm.</p>
<p>The next step is creating a firmwide prioritization process, for those instances where two competing business units want to use the same space at the same time. Some decisions will be easy as usually there is a widespread awareness of which business units trump others or which strategies are more &#8220;important&#8221; than others.</p>
<p>Failing that, you need to get the associated stakeholders in a room and hammer it out with the company&#8217;s best interests at the heart of the conversation. The dimensions I consider include financial impact, strategic impact, complexity (can we squeeze a less important test in first because it&#8217;s simple and not really lose much overall as a company?), and the impacts of delaying an effort until later.</p>
<p><strong>If you could offer 30 seconds of advice to CMOs about controlled experimentation in marketing, what would you say?</strong></p>
<p>If you aren&#8217;t testing, you are guessing. The guesses may be based on years of good experience and some halfway decent data, but they are still guesses and educated hunches more than verified truth.</p>
<blockquote><p>If you aren&#8217;t testing, <strong>you are guessing</strong>. The guesses may be based on years of good experience and some halfway decent data, but they are still guesses.</p></blockquote>
<p>If you want to <em>know</em>, with certainty, you must test. And it&#8217;s the new normal. The ones that refuse to embrace testing will find themselves at a severe disadvantage as more and more competitors in all industries start to test. And learn about interactions — they will likely change the way you think about your strategies.</p>
<p><em>Thank you, Andy — this was awesome!</em></p>
<p>The post <a href="http://chiefmartec.com/2013/04/advice-from-a-jedi-knight-of-marketing-experimentation/">Advice from a Jedi Knight of marketing experimentation</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/04/advice-from-a-jedi-knight-of-marketing-experimentation/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Does marketing science mean you can predict the future?</title>
		<link>http://chiefmartec.com/2013/04/does-marketing-science-mean-you-can-predict-the-future/?utm_source=rss&#038;utm_medium=rss&#038;utm_campaign=does-marketing-science-mean-you-can-predict-the-future</link>
		<comments>http://chiefmartec.com/2013/04/does-marketing-science-mean-you-can-predict-the-future/#comments</comments>
		<pubDate>Mon, 22 Apr 2013 19:30:19 +0000</pubDate>
		<dc:creator>Scott Brinker</dc:creator>
				<category><![CDATA[Marketing Data]]></category>

		<guid isPermaLink="false">http://chiefmartec.com/?p=438</guid>
		<description><![CDATA[<p>If I were a marketer psychologist — that is, a therapist to marketing teams, for which I&#8217;m sure there&#8217;s a market — I could imagine making a fine living by asking open-ended questions, such as &#8220;What does marketing science mean to you?&#8221;, and holding up a mirror to people&#8217;s responses. I hear you say data-driven. [...]</p><p>The post <a href="http://chiefmartec.com/2013/04/does-marketing-science-mean-you-can-predict-the-future/">Does marketing science mean you can predict the future?</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></description>
				<content:encoded><![CDATA[<p><img class="size-full wp-image-436 alignnone" alt="Marketing Scientists" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/ibm_marketing_scientists_600.png" width="600" height="606" /></p>
<p>If I were a marketer psychologist — that is, a therapist to marketing teams, for which I&#8217;m sure there&#8217;s a market — I could imagine making a fine living by asking open-ended questions, such as &#8220;What does <em>marketing science</em> mean to you?&#8221;, and holding up a mirror to people&#8217;s responses.</p>
<p><em>I hear you say data-driven. What&#8217;s your earliest memory of working with data?</em></p>
<p>&#8220;Marketing as a science&#8221; strikes me as a bit of a Rorschach test for marketers these days. The answers seem to vary tremendously, offering glimpses into an organization&#8217;s worldview and culture in our digitized and data-ified world. (To play fair, last month I wrote up my interpretation of that nomenclature inkblot by describing <a href="http://chiefmartec.com/2013/03/what-do-you-mean-by-marketing-as-a-science/"><strong>4 principles of good marketing science</strong></a>.)</p>
<p>So I&#8217;ve been eagerly consuming content, wherever I can find it, that champions science in marketing, to appreciate the different perspectives people bring to that concept. The latest piece I&#8217;ve read is a new IBM report, <a href="http://www.ibm.com/smarterplanet/us/en/centerforappliedinsights/article/marketingscience.html"><strong>Marketing science: From descriptive to prescriptive</strong></a>.</p>
<p>IBM surveyed 358 marketers, across a range of businesses and industries, to examine how they&#8217;re using data and scientific methods to impact business outcomes. In the graphic at the top of this post, they classified participants according to (Y-Axis) whether their analytic outcomes were descriptive, predictive, or prescriptive and (X-Axis) whether the influence of their analytical methods spanned marketing/sales, the whole enterprise, or across the entire value chain.</p>
<p>They labeled as &#8220;marketing scientists&#8221; those who combine predictive or prescriptive analytical outcomes with influence across the enterprise or the entire value chain. Only 23% of those surveyed qualified for the marketing scientist label.</p>
<p>Of course, one doesn&#8217;t need to qualify for their definition of a &#8220;marketing scientist&#8221; in order to be effective at using science in marketing. In fact, later on in the paper, IBM separately analyzes the results of marketers who report how well they apply science in their work. But what&#8217;s interesting is that those participants who did cluster into the marketing scientist category had a much higher propensity than &#8220;traditional marketers&#8221; or &#8220;constrained analysts&#8221; to use a scientific approach in general:</p>
<p><img class="alignnone size-full wp-image-437" alt="Applying Science in Marketing" src="http://cdn.chiefmartec.com/wp-content/uploads/2013/04/apply_science_ibm_study_600.png" width="600" height="775" /></p>
<p>In other words, there is a strong correlation between those marketers who embrace more advanced techniques (such as prescriptive analytics) and influence across the value chain of the organization with those who are generally more &#8220;scientific&#8221; in their approach, presumedly even in simpler scenarios.</p>
<p>That makes sense, although — as data science says — correlation does not imply causation.</p>
<p>I add that caveat, because while I appreciate the capabilities of prescriptive analytics and optimization across the entire value chain, I don&#8217;t believe that either of those is necessarily a <em>requirement</em> for applying good science in marketing.</p>
<p><strong>There are plenty of opportunities just within marketing/sales for better data-driven decision making and controlled experimentation that can generate terrific returns.</strong> I&#8217;d caution against setting the bar so high that people are discouraged from more modest marketing science.</p>
<p>I had the chance to talk with Derek Franks, a consultant for the IBM Center for Applied Insights and one of the authors of the report, who confirmed that testing hypotheses and running controlled experiments was, by far, &#8220;the most important step.&#8221;</p>
<p>&#8220;Start by conducting relatively small scale experiments,&#8221; Derek suggested. &#8220;Develop a hypothesis, test it, and modify it. That approach is much better than randomly walking around, looking for patterns in the data.&#8221;</p>
<p>I also asked him about the limits of prescriptive analytics in marketing science. <a href="http://en.wikipedia.org/wiki/Prescriptive_analytics">Prescriptive analytics</a>, as written on Wikipedia, automatically synthesizes big data, mathematical sciences, business rules, and machine learning to make predictions and then suggests decision options to take advantage of the predictions. It is the so-called &#8220;third phase&#8221; of business analytics which includes descriptive, predictive and prescriptive analytics.</p>
<p>While there are certainly scenarios where prescriptive analytics can be effective, I am a little concerned about the risk of overreaching with such techniques. After all, predicting the future is hard, especially when complexities of markets and human behavior are involved. How should marketers manage that?</p>
<p>&#8220;The biggest defense against this,&#8221; Derek replied, &#8220;is having marketing scientists, data scientists within your organization who really understand what they&#8217;re doing. They understand the limits of the data that they have access to and are careful to qualify what they can predict with a certain percentage of confidence.&#8221;</p>
<p>That&#8217;s fair. But I think it&#8217;s also important for marketing executives to calibrate realistic expectations. As Derek mentioned in our chat, &#8220;Not everyone needs to become a data scientist. <strong>But business executives need to be intelligent consumers of data.</strong>&#8221;</p>
<p>In my opinion, intelligent consumers of data are open-minded, curious, and willing to look at data through more than one lens. They value analytical decision making. But they also bring a healthy skepticism to the limits of the data they&#8217;re working with. Finding the right balance between data-driven and experience-driven management may be a big part of where the &#8220;art&#8221; of marketing still remains.</p>
<p>&#8220;The science of marketing isn&#8217;t going to replace the art of marketing,&#8221; Derek added at the end. &#8220;It will enhance the art of marketing. It&#8217;s not an either/or proposition at all, but rather complementary approaches.&#8221;</p>
<p>What does marketing as a science mean to you?</p>
<p>The post <a href="http://chiefmartec.com/2013/04/does-marketing-science-mean-you-can-predict-the-future/">Does marketing science mean you can predict the future?</a> appeared first on <a href="http://chiefmartec.com">Chief Marketing Technologist</a>.</p>]]></content:encoded>
			<wfw:commentRss>http://chiefmartec.com/2013/04/does-marketing-science-mean-you-can-predict-the-future/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
	</channel>
</rss>
