Warning: this content is older than 365 days. It may be out of date and no longer relevant.

You Ask, I Answer: Extracting Social Content Data

Ateeq asks, “I just want to be able to get some conversations around Google Analytics from Facebook and Twitter programmatically. Is there a tool that does that or should I aim to write some code in Python?”

You’re looking for social media monitoring. In this case, your best bets are tools like Talkwalker and Brand24. Unless, of course, you want content about it, in which case you want Buzzsumo. In this video, watch a quick tour of these three software packages as well as one of my favorite methods of analyzing this kind of data.

You Ask, I Answer: Extracting Social Content Data

Can’t see anything? Watch it on YouTube here.

Listen to the audio here:

Download the MP3 audio here.

Machine-Generated Transcript

What follows is an AI-generated transcript. The transcript may contain errors and is not a substitute for watching the video.

In today’s episode teak asks, I just want to be able to get some conversations around Google Analytics from Facebook and Twitter programmatically. Is there a tool that does that? Or should I aim to write some code in Python? Good question. You are looking for social media monitoring? Well, you’re looking for one of two things, you’re looking for social media monitoring, or you’re looking for content, visibility. So for social media monitoring, to have the tools that would recommend for this particular task would be either talk walker or brand 24. So let’s switch screens here.

This is talk Walker talk Walker allows you to put in search terms at so I’ve got Google Analytics with and without the space here. And then for your specific request about things like Facebook and Twitter. You can isolate those channels and

Provide reporting,

for getting data out of these systems programmatically your, if you if you mean, you want to be able to take it out on a regular basis, you’re going to want to get access to the API’s for these companies. So here we have, we have Twitter and Facebook feeds. If when you look here, we’ve got, you can embed on another platform where you can use an RSS feed for the data. You can also use JSON feed as well.

I typically will do CSV exports because I don’t have to do these on an ongoing basis usually have to do one shots. The other thing is you’ll you will notice there’s a substantial amount of non English here so you can use whatever the language of your choice is, if you want to use Arabic or Japanese or Russian or whatever, I forgot how many languages boarded, I can look.

A whole bunch. So that’s that would be an option within talk Walker.

extract the data. The same is true for brand 24. Go in, it’s set up your Google Analytics search, you can take a look at the mentions.

And then you can do data, different types of data exports. And you can also set it up so that you can integrate with things like slack as well. And you can see there’s Facebook, there’s Twitter, you will get different numbers from the various different platforms and things. So you’ll want to make sure that depending on the type of data, you’re using, different social platforms are better at different things. So for example, let’s look at just the raw numbers here. I’m going to go with media types.

So for Google Analytics in the last 30 days, talk Walker is pulling out 41,000 mentions of which the lion’s share are going to be

Twitter and then at one Facebook mentions on the other hand on brand 24 when you look at that, they have pull 1000 Facebook messages

for Google Analytics, only 5000 tweets so. So again, it depends on on which network you want different tools are going to be better at different networks. And if you want, both gonna have to, to subscribe to both. So that’s one set of options, the second set of options. The second option would be if you want to understand how content is is performing on these networks. So in this case, this is a tool called buzz Sumo put in Google Analytics.

And now instead of what social posts on Twitter or on Facebook, our most popular This is instead of looking at which,

which pieces of content which like web articles or blog articles were most shared on those different networks. So those are some options as well to look at

if you want specific content to see what gets shared the most.

Now, the question is what do you want to do with the information if you want to just get us

what people are talking about maybe industry professionals of some kind, to understand what you should be saying, in conversation on those networks, you want to use social media monitoring hands down, to be able to talk the talk in my language that people are using. So I switched over here at the themes, for example.

very broadly, I get a sense of everything that’s associated generally with this term, right? It’s a marketing tool. It’s calculations. It’s analytics. And then there are various different handles. Again, the different languages. However, if I want to use the data, to decide what content to create, if I’m if I’m looking for a longer form stuff,

I will probably want to use an export the data out of buzz Sumo because you can get the URLs for each of these articles, and then build some text mining, some text analytics on

What the top performing articles are. Typically when I do this, I will do a 9010 split. So I’ll take the top 10% of articles and analyze the major themes in an in that, and I’ll take the remaining remainder of the corpus. And I’ll analyze the themes that and what we’re looking for outliers, what are the things that are unique to the top 10% that are not in the bottom 90% if there’s a lot of content, in this case, there’s 943 articles. So you might want to do 2575. But that’s how you get the data from one of these three tools either talk Walker, brand 24, or buzz Sumo. And what you do with the data is exactly the same and in all those cases, you will take an export of it, and then you will start slicing and dicing it based on the top performing content and what it what it has in common. And then everything else. So interesting question, fun question. There’s a lot to be done in an analytics

you will have to engineer a lot of the features yourself so by that i mean these tools provide really nice rich exports but at the same time they can only do so much with the compute power that they have while maintaining responsiveness and speed of applications you will need to do heavy engineering of your own if you want to use the data for machine learning for advanced analytics for data science

these none of these software packages do that in a way that allows you to tune it and in a way that allows you to extract exactly the insights you want you’ll have to do the engineering itself so great question if you have follow up questions please leave them in the comments and of course please subscribe to the youtube channel and the newsletter i’ll talk to you soon one help solving your company’s data analytics and digital marketing problems this is trust insights.ai today and let us know how we can help you


You might also enjoy:


Want to read more like this from Christopher Penn? Get updates here:

subscribe to my newsletter here


AI for Marketers Book
Take my Generative AI for Marketers course!

Analytics for Marketers Discussion Group
Join my Analytics for Marketers Slack Group!