Guided Project: Finding the Best Markets to Advertise In, trying to break job roles to an itemized frequency table

Basics (4).ipynb (31.3 KB)

So my problem is; in the last code cell, I have two attempts to break the column into a frequency table.
I have tried combining the functions in that cell a dozen different ways to the point of questioning my sanity.

I am not even sure what I haven’t tried yet.

Click here to view the jupyter notebook file in a new tab

Hi @westlundderek
As far as I understand, you want to know the column JobRoleInterest frequency .

In your code, just convert the series cleaned into a list.

cleaned = fcc_survey['JobRoleInterest'].dropna().str.split(',')
frequency = {}
for row in list(cleaned):
    for val in row:
        if val in frequency:
            frequency[val] += 1
        else:
            frequency[val] = 1
print(len(frequency))
frequency

But the below frequency or dictionary keys need to be cleaned for correct frequency output.

[Output:]
236
{'   Data Scientist': 1120,
 '   DevOps / SysAdmin': 695,
 '   Front-End Web Developer': 2287,
 '   Mobile Developer': 1734,
 '   Product Manager': 600,
 '   Quality Assurance Engineer': 389,
 '   User Experience Designer': 1078,
 '  Bioinformatics ': 1,
 '  Data Scientist': 523,
 '  DevOps / SysAdmin': 232,
 '  Front-End Web Developer': 1246,
 '  Mobile Developer': 570,
 '  Product Manager': 214,
 '  Quality Assurance Engineer': 109,
 '  User Experience Designer': 391,
 ' AI Engineer': 1,
 ' AI and Machine Learning': 1,
 ' AI and neuroscience': 1,
 ' Analyst': 1,
 ' Anything that engages me': 1,
 ' Application Support Analyst': 1,
 ' Artificial Intelligence': 1,
 ' Artificial Intelligence ': 1,
 ' Artificial Intelligence Engineer': 1,
 ' Artificial Intelligence engineer': 1,
 ' Artificial intelligence': 1,
 ' Back-End Web Developer': 1997,
 ' Bioinformatics': 1,
 ' Bioinformatics/science ': 1,
 ' Bioinformatitian': 1,
 ' Bitcoin/Crypto': 1,
 ' Business Analyst': 2,
 ' Campaign Manager': 1,
 ' Compilers': 1,
 ' Criminal Defense Attorney-- focusing on cyber crimes ': 1,
 ' Cybersecurity': 1,
 ' Data Analyst': 2,
 ' Data Engineer': 944,
 ' Data analyst': 1,
 ' Databases': 1,
 ' Desktop Application Developer': 3,
 ' Desktop applications developer': 1,
 ' Embedded Developer': 1,
 ' Entrepreneur': 1,
 ' Entreprenuer / Web Dev Hustler ': 1,
 ' Ethical Hacker': 1,
 ' Founder': 1,
 ' Front End Web Development': 1,
 ' Full-Stack Web Developer': 2490,
 ' GIS Database Admin': 1,
 ' Game Developer': 1162,
 ' Growth Hacker': 1,
 ' I am interested in Game Development': 1,
 ' I dont yet know': 1,
 ' IT specialist ': 1,
 ' Information Architect': 1,
 ' Information Security': 986,
 ' Information Technology': 1,
 ' Infrastructure Architect ': 1,
 ' IoT': 1,
 ' Java developer': 1,
 ' Journalist': 1,
 ' Journalist/Graphic Designer/Marketing': 1,
 ' Library Developer': 1,
 ' Machine Learning': 1,
 ' Machine Learning ': 1,
 ' Machine Learning Engineer': 2,
 ' Machine Learning Engineer ': 1,
 ' Marketing': 1,
 ' Mobile Development': 1,
 ' Networking': 1,
 ' Operating Systems': 1,
 ' Product Designer': 2,
 ' Program Manager': 1,
 ' Programmer': 2,
 ' Project Management': 1,
 ' Project Manager': 1,
 ' Python Developer': 1,
 ' Researcher': 2,
 ' Robotics': 1,
 ' SEO': 1,
 ' SWE': 1,
 ' Scientific Programming': 1,
 ' Software Developer': 2,
 ' Software Developer or Front-End Web Developer': 1,
 ' Software Development': 1,
 ' Software Engineer': 6,
 ' Software Projects Manager': 1,
 ' Software developer': 1,
 ' Software engineer': 2,
 ' Software enginner': 1,
 ' System Administrator/Network': 1,
 ' System Software': 1,
 ' Teacher': 1,
 ' Tech art': 1,
 ' Tech lobbiest': 1,
 ' Technical Writer': 1,
 ' Technology-Business Liaison': 1,
 " This futurist's dream of using some tech in a way that inspires critical amounts of people to influence the changes we need to protect ": 1,
 ' UI Design': 1,
 ' UI Designer': 1,
 ' UX developer/designer': 1,
 ' User Interface Design': 1,
 ' User Interface Designer': 1,
 ' Web Design': 1,
 ' Web Designer': 1,
 ' a job in which I can use coding skills to create valuable portals to advance human rights': 1,
 ' app dev etc.': 1,
 ' back end': 1,
 ' back-end': 1,
 ' computer engineer': 1,
 ' creative coder / generative artist/designer': 1,
 ' data analyst': 2,
 ' designer': 1,
 ' developer': 1,
 ' etc...': 1,
 ' front-end': 1,
 ' game': 1,
 ' i dunno!!!!': 1,
 ' milatary engineer': 1,
 ' mobile developer': 1,
 ' network admin': 1,
 ' plc': 1,
 ' programmer': 1,
 ' security expert': 1,
 ' software engineer': 1,
 ' support scientific resaerch ': 1,
 ' virtual reality developer': 1,
 ' web': 1,
 'AI': 1,
 'AI Developer': 1,
 'All - whatever is required to develop tools to revolutionize the mechanical engineering process': 1,
 'Any of them.': 1,
 'Artificial Intelligence': 2,
 'Astrophysicist': 1,
 'BA or developer': 1,
 'Back-End Web Developer': 775,
 'Ceo': 1,
 'Cloud computing ': 1,
 'College professor': 1,
 'Computer Architect': 1,
 'Data Engineer': 304,
 'Data Reporter': 1,
 'Data Visualization Specialist': 1,
 'Data visualisation': 1,
 'Data/Interactive Journalist': 1,
 'Desings': 1,
 'Desktop Applications': 1,
 'Desktop Applications Programmer': 1,
 'Developer Evangelist': 1,
 'Digital Humanitites': 1,
 'Document Controller': 1,
 "Don't know yet": 1,
 'Education': 1,
 'Embedded hardware': 1,
 'Ethical Hacker': 1,
 'Financial Services': 1,
 'Front end': 1,
 'Front-End Web Designer': 1,
 'Full Stack Developer ': 1,
 'Full Stack Software Engineer': 1,
 'Full-Stack Web Developer': 1708,
 'GIS Developer': 1,
 'Game Developer': 466,
 "I don't know yet!": 1,
 "I'm just learning code to increase my skill-set. I see it as a literacy issue.": 1,
 'Informatician': 1,
 'Information Developer': 1,
 'Information Security': 340,
 'IoT Developer': 1,
 'Java developer': 1,
 'Machine learning and AI ': 1,
 'Machine learning engineer': 1,
 'Marketing Automation ': 1,
 'Natural Language Processing': 1,
 'Network': 1,
 'Network Engineer': 1,
 'Non technical ': 1,
 'Not Sure': 1,
 'Not Sure Yet': 1,
 'Not sure': 2,
 'Not sure yet': 2,
 'Not sure!': 1,
 'Pharmaceutical industry': 1,
 'Pharmacy tech': 1,
 'Physicist ': 1,
 'Programming': 1,
 'Project Manager': 1,
 'Project manager': 1,
 'Quant (Algorithmic Trader)': 1,
 'Real-time systems': 1,
 'Remote Support': 1,
 'Research': 1,
 'Research ': 1,
 'Research and education': 1,
 'Robotics Process Automation Specialist': 1,
 'Robotics and AI Engineer': 1,
 'Security Business Analyst ': 1,
 'Software Developer': 4,
 'Software Developper': 1,
 'Software Engineer': 5,
 'Software Engineer (Computer Science Based)': 1,
 'Software Engineering': 1,
 'Software Engineers': 1,
 'Software Specialist ': 1,
 'Software engineer': 1,
 'Software engineer ': 1,
 'Support Engineer or API Support': 1,
 'System Engineer': 1,
 'Systems Engineer': 1,
 'Systems Programmer': 1,
 'Systems Programming': 1,
 'Teacher. Teaching students to code. ': 1,
 'Technology Management': 1,
 'Unsure': 2,
 'Urban Planner': 1,
 'User Interface Designer': 1,
 'VR Technology developer': 1,
 'Web Designer': 1,
 'Web developer': 1,
 'Web development ': 1,
 'code developer...in whatever format': 1,
 'data journalist / data visualist': 1,
 'email coder': 1,
 'full stack developer': 1,
 'full-stack developer': 1,
 "i don't know what the difference is between most of these soz lol": 1,
 'idk': 1,
 'improving in my current career as a Learning technologist': 1,
 'lab scientist': 1,
 'non-programmer': 1,
 'philosopher': 1,
 'programmer': 1,
 'software developer': 1,
 'undeceided': 1,
 'undecided': 2}

Hope it helps!

1 Like

I have very mixed feelings about it being that easy. Thanks a lot.

1 Like