Read the dataset into Spark
Table job_postings creating
from pyspark.sql import SparkSession
spark = SparkSession.builder \
.appName("MySparkApp") \
.getOrCreate()
raw_postings = spark.read.option("header", True).csv("lightcast_job_postings.csv")Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
25/03/27 14:06:40 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicableimport pyspark.sql.functions as F
raw_postings = (
spark.read
.option("header", True)
.option("multiline", True)
.option("quote", '"')
.option("escape", '"')
.csv("lightcast_job_postings.csv")
)
# Creating job_postings table
job_postings = raw_postings.select(
F.col("id").alias("job_id"),
F.col("title_clean"),
F.col("company").alias("company_id"),
F.col("naics_2022_5").cast("int").alias("industry_id"),
F.col("employment_type_name"),
F.col("remote_type_name"),
F.col("body"),
F.col("min_years_experience").cast("double"),
F.col("max_years_experience").cast("double"),
F.col("salary").cast("double"),
F.col("salary_from").cast("double"),
F.col("salary_to").cast("double"),
F.col("location").alias("location_id"),
F.col("posted"),
F.col("expired"),
F.col("duration")
)
job_postings.createOrReplaceTempView("job_postings")
# Printing
job_postings.show(10, truncate=False)25/03/27 14:06:48 WARN SparkStringUtils: Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting 'spark.sql.debug.maxToStringFields'.+----------------------------------------+-------------------------------------------+----------+-----------+----------------------+----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+--------------------+--------+-----------+---------+-------------------------------------------------+----------+----------+--------+
|job_id |title_clean |company_id|industry_id|employment_type_name |remote_type_name|body |min_years_experience|max_years_experience|salary |salary_from|salary_to|location_id |posted |expired |duration|
+----------------------------------------+-------------------------------------------+----------+-----------+----------------------+----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+--------------------+--------+-----------+---------+-------------------------------------------------+----------+----------+--------+
|1f57d95acf4dc67ed2819eb12f049f6a5c11782c|enterprise analyst ii iii |894731 |44133 |Full-time (> 32 hours)|[None] |31-May-2024\n\nEnterprise Analyst (II-III)\n\nMerchandising\n\nEl Dorado\n\nArkansas\n\nJob Posting\n\nGENERAL DESCRIPTION OF POSITION\nPerforms business analysis using various techniques, e.g. statistical analysis, explanatory and predictive modeling, data mining. Identifies trends and patterns in data and can explain business drivers or the why behind the data. Skills typically attained in a four-year degree plus the understanding and application of analytical tools and techniques that come with 2-5 years of experience including advanced MS office skills, advanced SQL, PowerBI, and exporting/building data models.\n\nESSENTIAL DUTIES AND RESPONSIBILITIES\n1. Gathers insight and performs routine and ad hoc reporting using various techniques (statistical analysis, data mining).\n2. Frames unstructured problems\n3. Performs data extraction/gathering, reconciling ambiguous data, and executes the hypothesis-driven approach.\n4. Develops fact-based and actionable recommendations/presentations.\n5. Analyze data for trends and patterns, and interpret data with a clear objective in mind\n6. Proficiently design and develop algorithms and models to use against large datasets to create business insights\n7. Make appropriate selection, utilization and interpretation of advanced analytical methodologies\n8. Effectively communicate insights and recommendations to both technical and non-technical leaders and business customers/partners including preparing reports, updates and/or presentations related to progress made on a project or solution\n9. Work with project teams and business partners to determine project goals and deliver productionized models and tools\n10. Effectively develop trust and collaboration with internal customers and cross-functional teams\n\n\nQUALIFICATIONS\nTo perform this job successfully, an individual must be able to perform each essential duty mentioned satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.\n\nEDUCATION AND EXPERIENCE\nBroad knowledge of such fields as economics, statistics, business administration, finance, math, science etc. Equivalent to a four-year college degree, plus 2-5 years related experience and/or training, or equivalent combination of education and experience.\n\nAuto req ID\n\n181767BR\n\nStore Number/Dept Number\n\n299900055000 - Strat Plan Perform Mgmt\n\nStore Address\n\n200 E Peach St\n\nStore Zip\n\n71730 |2.0 |2.0 |NULL |NULL |NULL |{\n "lat": 33.20763,\n "lon": -92.6662674\n} |2024-06-02|2024-06-08|6.0 |
|0cb072af26757b6c4ea9464472a50a443af681ac|oracle consultant reports |133098 |56132 |Full-time (> 32 hours)|Remote |Oracle Consultant - Reports (3592)\n\nat SMX in Augusta, Maine, United States\n\nJob Description\n\nOracle Consultant - Reports (3592)at SMX (https://www.smxtech.com/careers/)\n\nUnited States\n\nCreoal has recently become a proud subsidiary of SMX, marking an exciting collaboration that enhances our collective capabilities to deliver cutting-edge digital transformation solutions.SMX has a growing Oracle Cloud Practice, focusing on Commercial and Public Sector customers.\n\nSMX/Creoal drives digital transformation through innovative solutions that leverage Oracle, Salesforce, and leading-edge technologies for Federal, public sector, and commercial organizations across the globe. We employ a holistic approach of People, Process, and Technology.\n\nThe value of our organization is rooted in our team, whose experience across a wide range of technologies delivers tangible results to our clients. SMX/Creoal's skilled professional resources represent the industry's most respected digital transformation experts.\n\nWe are looking for an Oracle Consultant to support our client in this 100% remote role.\n\nEssential Duties and Responsibilities for the Oracle Consultant include:\n\n+ Providing direction and specialist knowledge in utilizing the following tools:\n\n+ Oracle Analytics Cloud (OAC)\n\n+ Oracle Transactional Business Intelligence (OTBI)\n\n+ Oracle Business Intelligence Publisher (BI Publisher)\n\n+ Developing reports and other business intelligence solutions to meet customers' needs in the following domains/fields:\n\n+ Financials\n\n+ Supply Chain\n\n+ Procurement\n\n+ Project Accounting\n\n+ Development of reusable reports using tools such as OTBI, Financial Reporting Studio, and OAC\n\nRequired Skills and Experience:\n\n+ Clearance Required: None\n\n+ US Citizenship is required for work on this contract. Applicant must be residing in the United States.\n\n+ 3-5 years of experience is required in the following toolsets:\n\n+ OAC\n\n+ OTBI\n\n+ BI Publisher\n\n+ PL/SQL\n\n+ Exposure to large-scale implementation projects, principally Oracle Fusion Cloud\n\nDesired Qualifications:\n\n+ Familiarity with Oracle Integration Cloud (OIC) is a plus\n\n+ Past background with Oracle's EBusiness Suite (EBS) product\n\n\#cjpost #LI-REMOTE #LI-JJ1\n\nAt SMX, we are a team of technical and domain experts dedicated to enabling your mission. From priority national security initiatives for the DoD to highly assured and compliant solutions for healthcare, we understand that digital transformation is key to your future success.\n\nWe share your vision for the future and strive to accelerate your impact on the world. We bring both cutting edge technology and an expansive view of what's possible to every engagement. Our delivery model and unique approaches harness our deep technical and domain knowledge, providing forward-looking insights and practical solutions to power secure mission acceleration.\n\nSMX is committed to hiring and retaining a diverse workforce. All qualified candidates will receive consideration for employment without regard to disability status, protected veteran status, race, color, age, religion, national origin, citizenship, marital status, sex, sexual orientation, gender identity or expression, pregnancy or genetic information. SMX is an Equal Opportunity/Affirmative Action employer including disability and veterans.\n\nSelected applicant will be subject to a background investigation. |3.0 |3.0 |NULL |NULL |NULL |{\n "lat": 44.3106241,\n "lon": -69.7794897\n} |2024-06-02|2024-08-01|NULL |
|85318b12b3331fa490d32ad014379df01855c557|data analyst |39063746 |52429 |Full-time (> 32 hours)|[None] |Taking care of people is at the heart of everything we do, and we start by taking care of you, our valued colleague. A career at Sedgwick means experiencing our culture of caring. It means having flexibility and time for all the things that are important to you. It's an opportunity to do something meaningful, each and every day. It's having support for your mental, physical, financial and professional needs. It means sharpening your skills and growing your career. And it means working in an environment that celebrates diversity and is fair and inclusive.\n\nA career at Sedgwick is where passion meets purpose to make a positive impact on the world through the people and organizations we serve. If you are someone who is driven to make a difference, who enjoys a challenge and above all, if you're someone who cares, there's a place for you here. Join us and contribute to Sedgwick being a great place to work.\n\nGreat Place to Work\n\nMost Loved Workplace\n\nForbes Best-in-State Employer\n\nData Analyst\n\nPRIMARY PURPOSE To collect, analyze and report data; to be responsible for the data integrity; and to generate reports verifying and ensuring data integrity and accuracy.\n\nESSENTIAL FUNCTIONS and RESPONSIBILITIES\n\nCompiles data; prepares and distributes reports; and analyzes results.\n\nEnsures data integrity; develops and produces reports utilized in measuring data accuracy.\n\nMay assist in the completion of appropriate client set-up and maintenance (parameter) forms.\n\nSupports internal and external users including reports, installation, screen, etc.\n\nCreates exception reports to identify fields of incorrect data.\n\nGenerates custom reports for internal and external client.\n\nADDITIONAL FUNCTIONS and RESPONSIBILITIES\n\nPerforms other duties as assigned.\n\nSupports the organization's quality program(s).\n\nQUALIFICATIONS\n\nEducation & Licensing\n\nBachelor's degree from an accredited college or university preferred.\n\nExperience\n\nFive (5) years of related experience or equivalent combination of education and experience required. Two (2) years of query and report writing experience strongly preferred.\n\nSkills & Knowledge\n\nStrong knowledge of query and report writing\n\nExcellent oral and written communication, including presentation skills\n\nPC literate, including Microsoft Office products\n\nAnalytical and interpretive skills\n\nStrong organizational skills\n\nExcellent interpersonal skills\n\nExcellent negotiation skills\n\nAbility to meet or exceed Performance Competencies\n\nWORK ENVIRONMENT\n\nWhen applicable and appropriate, consideration will be given to reasonable accommodations.\n\nMental : Clear and conceptual thinking ability; excellent judgment, troubleshooting, problem solving, analysis, and discretion; ability to handle work-related stress; ability to handle multiple priorities simultaneously; and ability to meet deadlines\n\nPhysical : Computer keyboarding, travel as required\n\nAuditory/Visual : Hearing, vision and talking\n\nNOTE : Credit security clearance, confirmed via a background credit check, is required for this position.\n\nThe statements contained in this document are intended to describe the general nature and level of work being performed by a colleague assigned to this description. They are not intended to constitute a comprehensive list of functions, duties, or local variances. Management retains the discretion to add or to change the duties of the position at any time.\n\nSedgwick is an Equal Opportunity Employer and a Drug-Free Workplace.\n\nIf you're excited about this role but your experience doesn't align perfectly with every qualification in the job description, consider applying for it anyway! Sedgwick is building a diverse, equitable, and inclusive workplace and recognizes that each person possesses a unique combination of skills, knowledge, and experience. You may be just the right candidate for this or other roles.\n\nTaking care of people is at the heart of everything we do. Caring counts\n\nSedgwick is a leading global provider of technology-enabled risk, benefits and integrated business solutions. Every day, in every time zone, the most well-known and respected organizations place their trust in us to help their employees regain health and productivity, guide their consumers through the claims process, protect their brand and minimize business interruptions. Our more than 30,000 colleagues across 80 countries embrace our shared purpose and values as they demonstrate what it means to work for an organization committed to doing the right thing - one where caring counts. Watch this video to learn more about us. (https://www.youtube.com/watch?v=ywxedjBGSfA) |5.0 |NULL |NULL |NULL |NULL |{\n "lat": 32.7766642,\n "lon": -96.7969879\n} |2024-06-02|2024-07-07|35.0 |
|1b5c3941e54a1889ef4f8ae55b401a550708a310|sr lead data mgmt analyst sas product owner|37615159 |52211 |Full-time (> 32 hours)|[None] |About this role:\n\nWells Fargo is looking for a SAS Platform and Tools L2 Product Owner with a specialization in migrating from SAS 9 Grid to SAS Viya 4 on Google Cloud (SaaS). This key position involves leading the development and enhancement of our SAS-based analytics platform while orchestrating a seamless transition to the next-generation SAS Viya 4 environment.\n\nIn this role, you will:\n\nAct as an advisor to leadership to develop or influence objectives, plans, specifications, resources, and long-term goals for highly complex business and technical needs\n\nLead the strategy and resolution of highly complex and unique challenges requiring in-depth evaluation across multiple areas or the enterprise, delivering solutions that are long-term, large-scale and require vision, creativity, innovation, advanced analytical and inductive thinking\n\nProvide vision, direction, and expertise to senior leadership on implementing innovative and significant business solutions\n\nRecommend remediation of process or control gaps that align to management strategy\n\nStrategically engage with all levels of professionals and managers across the enterprise and serve as an expert advisor to leadership\n\nRepresent client in cross-functional groups to develop companywide data governance strategies\n\nPartner with groups companywide to coordinate and drive collaboration on solution design and remediation execution\n\nProduct Vision and Strategy:\n\nDefine and articulate a clear product vision and strategy for both SAS Platform and Tools and the migration to SAS Viya 4.\n\nCollaborate with stakeholders to align technical solutions with organizational goals.\n\nRoadmap Development:\n\nDevelop and maintain a comprehensive product roadmap for SAS Platform and Tools, prioritizing features and enhancements based on business value.\n\nPlan and execute the migration roadmap from SAS 9 Grid to SAS Viya 4, ensuring a phased and efficient transition.\n\nMigration Strategy: SAS 9 Grid to SAS Viya 4:\n\nAssess the existing SAS 9 Grid environment, identifying workloads, dependencies, and hardware configurations.\n\nDevelop a migration plan, including data migration, re-engineering SAS 9 Grid workloads, and establishing parallel operations for a smooth transition.\n\nCross-functional Collaboration:\n\nCollaborate with development teams, data scientists, and other stakeholders to ensure successful implementation of product features and migration processes.\n\nAct as a liaison between technical and non-technical teams, fostering a collaborative environment.\n\nRequirements Gathering:\n\nCollect and analyze user feedback, market trends, and competitive intelligence to inform product decisions.\n\nDefine detailed product requirements, user stories, and acceptance criteria for SAS Platform and the migration to SAS Viya 4.\n\nManage on-prem SAS products:\n\nEffectively manage BAU (Business As Usual) product backlog and priorities\n\nDrive Data Center Exit strategy for SAS products\n\nQuality Assurance:\n\nCoordinate with QA teams to define and execute test plans, ensuring the reliability and performance of both SAS Platform and SAS Viya 4.\n\nConduct thorough testing during the migration process to identify and rectify any issues.\n\nUser Training and Support:\n\nDevelop and deliver training programs for end-users on SAS Platform and Tools as well as SAS Viya 4.\n\nProvide ongoing support and troubleshooting assistance during and post-migration.\n\nMonitoring and Optimization:\n\nEstablish monitoring mechanisms for SAS Platform and Tools and SAS Viya 4, tracking performance and optimizing configurations.\n\nContinuously improve SAS Viya 4 configurations based on performance data.\n\nRequired Qualification\n\n7+ years of Data Management, Business Analysis, Analytics, or Project Management experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education\n\n3+ years of experience in platform/tool operations, architecture and strategy\n\n1+ years of Agile experience\n\nDesired Qualification:\n\nExperience with Cloud Data Platforms\n\nPrior experience in migrating on-prem SAS to Cloud\n\nManaged SAS platform with operational responsibilities\n\nExperience with design of multi-tenant data architecture and its configuration spanning across both on-prem, cloud and hybrid environments\n\nExperience in data architecture, strategy, implementing user journeys within the data domain for large enterprise strength platforms.\n\nProven experience of leading development of products (data related), strong demonstration of managing SDLC and delivering outcomes.\n\nDemonstrate past work experience of organizing and enabling teams in a scaled Agile environment.\n\nGoogle Cloud certification is desired.\n\nExperience creating and implementing strategic plans and roadmaps at the executive level for enterprise-wide business initiatives\n\nJob Expectations:\n\nAbility to travel up to 10%\n\nThis position offers a hybrid work schedule\n\nWillingness to work on-site in one of the listed locations\n\nVisa sponsorship is not available for this position\n\nLocations: Charlotte, NC; Phoenix, AZ; Addison, TX; West Des Moines, IA\n\n401 S. Tryon St. Charlotte, NC\n\n1525 W WT Harris Blvd. Charlotte, NC\n\n11601 N Black Canyon Hwy. Phoenix, AZ\n\n5080 Spectrum Dr. Addison, TX\n\n800 S. Jordan Creek Pkwy. West Des Moines, IA\n\nNote: Job posting may come down early due to volume of applicants.\n\nPosting End Date:\n\n3 Jun 2024\n\n*Job posting may come down early due to volume of applicants.\n\nWe Value Diversity\n\nAt Wells Fargo, we believe in diversity, equity and inclusion in the workplace; accordingly, we welcome applications for employment from all qualified candidates, regardless of race, color, gender, national origin, religion, age, sexual orientation, gender identity, gender expression, genetic information, individuals with disabilities, pregnancy, marital status, status as a protected veteran or any other status protected by applicable law.\n\nEmployees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.\n\nCandidates applying to job openings posted in US: All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.\n\nCandidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.\n\nApplicants with Disabilities\n\nTo request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .\n\nDrug and Alcohol Policy\n\nWells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.\n\nCompany: WELLS FARGO BANK\n\nReq Number: R-372422-3\n\nUpdated: Sun Jun 02 04:15:06 UTC 2024\n\nLocation: PHOENIX,Arizona|3.0 |NULL |NULL |NULL |NULL |{\n "lat": 33.4483771,\n "lon": -112.0740373\n}|2024-06-02|2024-07-20|48.0 |
|cb5ca25f02bdf25c13edfede7931508bfd9e858f|comisiones de por semana comiensa rapido |0 |99999 |Part-time / full-time |[None] |Comisiones de $1000 - $3000 por semana... Comiensa Rapido!!! (MODESTO AND SURROUNDING AREAS) LH/GM compensation: COMMISSION EASY SALES employment type: job title: SALES Comisiones de $1000 - $3000 por semana... Comiensa Rapido!!! No tengas miedo de Comisiones este trabajo es facil nada mas tienes que aprenderlo con nuestro excelente entrenamiento y empiesas aser dinero Rapido. Company / Compania Lincoln Heritage Life Insurance Co. More than 60 years in business! TENEMOS MAS DE 60 ANOS EN NEGOCIO!!!!! Agency / Agencia GOLDEN MEMORIAL AGENCY #1 Final Expense Agency in the Country Que vendemos? Seguro de vida: solo un Producto Gastos Finales Planes Funerales" What do we Sell? Small whole life policies Necesito Experiencia? No se ocupa nada de experiencia, Solo ganas de Aprender ! Do I need Experience? No. All you need is work ethic to grow with a Winning Team!!! SI No tienes seguro social No te preocupes, si noms tienes un ITIN es suficiente para sacar la licencia del estado. Cuesta el entrenamiento? No !!! Entrenamiento es Gratis . Tenemos Videos EN INGLES Y ESPANOL................. Online Training..............In person Class Training...........&.......Field Training with a Manager. Que se ocupa para tener xito y hacer dinero ? Presntate cada da con una actitud positiva y listo para trabajar al 100. 100% comisin How much money can you make in a year? Our Agents are making from $35,000 to $150,000 Annually, Managers are making from $200,000 to over 1 Million Annually. What makes our Final Expense Company a Great Company to work for? 1. We get paid in 24hrs. Sell a plan and submit a application with a 1st payment Check, you get paid within 24hrs direct deposit into your bank account. 2. We give coverage to 98% of people regardless of their Health conditions. 3. We pay out claims within 24 to 48hrs 4. We give coverage to people who Do Not have a social security number. 4. We have a Accidental, Death & Dismemberment Rider for $5.00 ($100,000 additional coverage) 5. We have a Child Rider $4 per child $10,000 coverage 6. Our Clients receive a Free Membership to Funeral Consumer Guardian Society, which helps the customer plan their final wishes and Funeral exactly as they choose. (This Free membership to FCGS can save them up to $4000 on a Traditional Funeral and $600 on a Cremation) Down below are the Qualifications to work on our Team Full Time & Part Time Must Follow our Training System. Give me a call and leave me a brief message. Gracias!!!!! Thanks!!!! IF YOU HAVE MORE QUESTIONS TEXT OR CALL ME SO I CAN EMAIL YOU MORE INFORMATION TO GET YOU STARTED. CALL OR TEXT ME TODAY 800-307-1269 Please leave a message!!! Llmame Hoy !! 800-307-1269 Porfavor deja su mensaje!!! CALL OR TEXT ME TODAY 800-307-1269 Please leave a message!!! Llmame Hoy !! 800-307-1269 Porfavor deja su mensaje!!! Oscar 800-307-1269 Porfavor deja su mensaje Principals only. Recruiters, please don't contact this job poster. post id: 7747584269 updated: [ ] |NULL |NULL |92500.0 |35000.0 |150000.0 |{\n "lat": 37.6392595,\n "lon": -120.9970014\n}|2024-06-02|2024-06-17|15.0 |
|35a6cd2183d9fb270e3f504b270f36d43cb759a6|sr lead data analyst |2233642 |51781 |Full-time (> 32 hours)|Remote |About Lumen\n\nLumen connects the world. We are igniting business growth by connecting people, data and applications - quickly, securely, and effortlessly. Together, we are building a culture and company from the people up - committed to teamwork, trust and transparency. People power progress.\n\nLumen's commitment to workplace inclusion and employee support shines bright. We've made the Newsweek 2024 Greatest Workplaces for Diversity list and achieved a perfect score of 100 on the Human Rights Campaign Corporate Equality Index (CEI) for the fifth consecutive year. Plus, we're the top employer in the communications and telecom industry, ranking 12th overall across all industries in The American Opportunity Index.\n\nWe're looking for top-tier talent and offer the flexibility you need to thrive and deliver lasting impact. Join us as we digitally connect the world and shape the future.\n\nThe Role\n\nThe Senior Lead Data Analyst has responsibility for data, reporting, metrics, and analytics within the Mass Markets Dispatch Operations organization at Lumen. This role will support the Business Intelligence Manager and Analytics team with analysis, reporting, and solutioning activities. They will provide guidance to the business on short- and long-term decisions and help drive performance improvements.\n\nLocation and Schedule\n\nThis is a Work From Home position in the United States.\n\nThe Main Responsibilities\n\n Provides business analysis and support for Mass Markets Dispatch Operations teams\n\n Creates ad-hoc reports along with creation and presentation of quality dashboards that provide operational visibility to the business unit(s)\n\n Defines and provides data evidence to support business cases and quantify business opportunities for optimization\n\n Defines the data gathered and determines patterns pertaining to key performance indicators (KPIs) and business challenges\n\n Defines and provides data to support 'control' of delivered solutions (value realization)\n\n Develops high quality graphs, reports, and presentations of data results\n\n Performs statistical analyses when needed\n\n Identifies, analyzes, and interprets trends or patterns in sometimes complex data sets\n\n Presents standard data sets and information in an understandable and compelling manner\n\n Executes different data analytics to ensure the completeness, quality, and consistency of data used for analytics across systems\n\n Identifies, analyzes, documents, and improves existing business processes\n\n Confirms business assumptions with data driven facts\n\n Collaborates with all Mass Markets Dispatch Operations teams on data, results, and findings\n\nWhat We Look For in a Candidate\n\n Demonstrated ability in developing complex automated Business Intelligence solutions using software such as Power BI, QlikSense, Tableau, or Looker\n\n PL/SQL experience\n\n Database Management Systems experience such as Oracle, Microsoft SQL Server, or Snowflake\n\n Python development experience\n\n Extract, Transfer, Load (ETL) experience\n\n Combined IT and Business Operations background\n\n Bachelor's Degree preferred, or equivalent combination of education, training, and experience\n\n Fireworks/Bidmaster experience\n\n VBA/BASH/PHP development experience\n\nCompensation\n\nThe starting salary for this role differs based on the employee's primary work location. Employees typically do not start at the top of the range, though compensation depends on each individual's qualifications.\n\nLocation Based Pay Ranges\n\n$94420 - $125890 in these states: AR, ID, KY, LA, ME, MS, NE, SC, and SD.\n\n$99390 - $132510 in these states: AZ, AL, FL, GA, IN, IA, KS, MO, MT, NM, ND, OH, OK, PA, TN, UT, VT, WV, WI, and WY.\n\n$104360 - $139140 in these states: CO, HI, MI, MN, NV, NH, NC, OR, and RI.\n\n$109330 - $145770 in these states: AK, CA, CT, DE, DC, IL, MD, MA, NJ, NY, TX, VA, and WA.\n\nAs with the pay range variety that's based on the region of a country, specific offers are determined by various factors such as experience, education, skills, certifications and other business needs.\n\nWhat to Expect Next\n\nRequisition #: 333643\n\nBackground Screening\n\nIf you are selected for a position, there will be a background screen, which may include checks for criminal records and/or motor vehicle reports and/or drug screening, depending on the position requirements. For more information on these checks, please refer to the Post Offer section of our FAQ page (https://jobs.lumen.com/global/en/faq) . Job-related concerns identified during the background screening may disqualify you from the new position or your current role. Background results will be evaluated on a case-by-case basis.\n\nPursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.\n\nEqual Employment Opportunities\n\nWe are committed to providing equal employment opportunities to all persons regardless of race, color, ancestry, citizenship, national origin, religion, veteran status, disability, genetic characteristic or information, age, gender, sexual orientation, gender identity, gender expression, marital status, family status, pregnancy, or other legally protected status (collectively, protected statuses). We do not tolerate unlawful discrimination in any employment decisions, including recruiting, hiring, compensation, promotion, benefits, discipline, termination, job assignments or training.\n\nDisclaimer\n\nThe job responsibilities described above indicate the general nature and level of work performed by employees within this classification. It is not intended to include a comprehensive inventory of all duties and responsibilities for this job. Job duties and responsibilities are subject to change based on evolving business needs and conditions.\n\nSalary Range\n\nSalary Min :\n\n94420\n\nSalary Max :\n\n145770\n\nThis information reflects the anticipated base salary range for this position based on current national data. Minimums and maximums may vary based on location. Individual pay is based on skills, experience and other relevant factors.\n\nThis position is eligible for either short-term incentives or sales compensation. Director and VP positions also are eligible for long-term incentive. To learn more about our bonus structure, you can view additional information here. (https://jobs.lumen.com/global/en/compensation-information) We're able to answer any additional questions you may have as you move through the selection process.\n\nAs part of our comprehensive benefits package, Lumen offers a broad range of Health, Life, Voluntary Lifestyle and other benefits and perks that enhance your physical, mental, emotional and financial wellbeing. You can learn more by clicking here. (https://centurylinkbenefits.com)\n\nNote: For union-represented postings, wage rates and ranges are governed by applicable collective bargaining agreement provisions.\n\nApplication Deadline\n\n06/05/2024 |NULL |NULL |110155.0|94420.0 |125890.0 |{\n "lat": 0,\n "lon": 0\n} |2024-06-02|2024-06-12|10.0 |
|06de8d192f30b1d8d3c575d453faf143d332f4d4|talent data analyst |44896740 |33441 |Full-time (> 32 hours)|[None] |Id : 2501314,\nTitle : Talent Data Analyst,\nCategory : Human Resources,\nRequisitionType : Professional - Exempt, IDL,\nJobGrade : null,\nRequisitionId : 300000384479638,\nExternalPostedStartDate : 2024-05-31T16:14:49 00:00,\nJobLevel : null,\nJobSchedule : null,\nJobShift : null,\nStudyLevel : Bachelors,\nInternationalTravelRequired : null,\nExternalContactName : null,\nExternalContactEmail : null,\nContractType : null,\nExternalPostedEndDate : null,\nJobFamilyId : 300000006382290,\nGeographyId : 300000001593176,\nGeographyNodeId : 100000428214026,\nExternalDescriptionStr : Job Summary:onsemi is seeking a Talent Data Analyst responsible for providing accurate, reliable, and accessible people and business metrics. As the Talent Data Analyst, you will work closely with HR leadership to provide data solutions for the organization at a global level. The role will also liaise with various cross-functional partners and business stakeholders to effectively organize and distill data, ask appropriate questions to understand hypotheses and requests, and present complex data in a compelling manner.We are looking for a Talent Data Analyst who shares our passion for building new functionality and improving existing systems. If you are curious and inquisitive, have strong critical thinking and analytical skills, and you can thrive managing concurrent projects while working with a global team to drive outcomes this may be the role for you! ,\nCorporateDescriptionStr : onsemi (Nasdaq: ON) is driving disruptive innovations to help build a better future. With a focus on automotive and industrial end-markets, the company is accelerating change in megatrends such as vehicle electrification and safety, sustainable energy grids, industrial automation, and 5G and cloud infrastructure. With a highly differentiated and innovative product portfolio, onsemi creates intelligent power and sensing technologies that solve the world's most complex challenges and leads the way in creating a safer, cleaner, and smarter world. More details about our company benefits can be found here: https://www.onsemi.com/careers/career-benefits,\nOrganizationDescriptionStr : We are committed to sourcing, attracting, and hiring high-performance innovators, while providing all candidates a positive recruitment experience that builds our brand as a great place to work. onsemi is an Equal Opportunity and Affirmative Action employer. The Company maintains policies and practices that are designed to prevent discrimination or harassment against any qualified applicant or employee to the extent prohibited by federal, state and local laws and regulations. By way of example, discrimination on the basis of race (actual or perceived), ethnicity, color, religion, ancestry, national origin, citizenship, sex, age, marital status, sexual orientation, physical or mental disability, medical condition, genetic information, military or veteran status, gender identity, gender expression, or any other characteristic protected by applicable law is prohibited. If you are an individual with a disability and require a reasonable accommodation to complete any part of the application process, or are limited in the ability or unable to access or use this online application process and need an alternative method for applying, you may contact Talent.acquisition@onsemi.com for assistance.,\nShortDescriptionStr : ,\nContentLocale : en,\nPrimaryLocation : Scottsdale, AZ, United States,\nPrimaryLocationCountry : US, |NULL |NULL |NULL |NULL |NULL |{\n "lat": 33.4941704,\n "lon": -111.9260519\n}|2024-06-02|2024-08-01|NULL |
|3d589c9d84677ca9468a5bc82295456e0ce6b13f|data analyst |39063746 |52429 |Full-time (> 32 hours)|[None] |Taking care of people is at the heart of everything we do, and we start by taking care of you, our valued colleague. A career at Sedgwick means experiencing our culture of caring. It means having flexibility and time for all the things that are important to you. It's an opportunity to do something meaningful, each and every day. It's having support for your mental, physical, financial and professional needs. It means sharpening your skills and growing your career. And it means working in an environment that celebrates diversity and is fair and inclusive.\n\nA career at Sedgwick is where passion meets purpose to make a positive impact on the world through the people and organizations we serve. If you are someone who is driven to make a difference, who enjoys a challenge and above all, if you're someone who cares, there's a place for you here. Join us and contribute to Sedgwick being a great place to work.\n\nGreat Place to Work\n\nMost Loved Workplace\n\nForbes Best-in-State Employer\n\nData Analyst\n\nPRIMARY PURPOSE To collect, analyze and report data; to be responsible for the data integrity; and to generate reports verifying and ensuring data integrity and accuracy.\n\nESSENTIAL FUNCTIONS and RESPONSIBILITIES\n\nCompiles data; prepares and distributes reports; and analyzes results.\n\nEnsures data integrity; develops and produces reports utilized in measuring data accuracy.\n\nMay assist in the completion of appropriate client set-up and maintenance (parameter) forms.\n\nSupports internal and external users including reports, installation, screen, etc.\n\nCreates exception reports to identify fields of incorrect data.\n\nGenerates custom reports for internal and external client.\n\nADDITIONAL FUNCTIONS and RESPONSIBILITIES\n\nPerforms other duties as assigned.\n\nSupports the organization's quality program(s).\n\nQUALIFICATIONS\n\nEducation & Licensing\n\nBachelor's degree from an accredited college or university preferred.\n\nExperience\n\nFive (5) years of related experience or equivalent combination of education and experience required. Two (2) years of query and report writing experience strongly preferred.\n\nSkills & Knowledge\n\nStrong knowledge of query and report writing\n\nExcellent oral and written communication, including presentation skills\n\nPC literate, including Microsoft Office products\n\nAnalytical and interpretive skills\n\nStrong organizational skills\n\nExcellent interpersonal skills\n\nExcellent negotiation skills\n\nAbility to meet or exceed Performance Competencies\n\nWORK ENVIRONMENT\n\nWhen applicable and appropriate, consideration will be given to reasonable accommodations.\n\nMental : Clear and conceptual thinking ability; excellent judgment, troubleshooting, problem solving, analysis, and discretion; ability to handle work-related stress; ability to handle multiple priorities simultaneously; and ability to meet deadlines\n\nPhysical : Computer keyboarding, travel as required\n\nAuditory/Visual : Hearing, vision and talking\n\nNOTE : Credit security clearance, confirmed via a background credit check, is required for this position.\n\nThe statements contained in this document are intended to describe the general nature and level of work being performed by a colleague assigned to this description. They are not intended to constitute a comprehensive list of functions, duties, or local variances. Management retains the discretion to add or to change the duties of the position at any time.\n\nSedgwick is an Equal Opportunity Employer and a Drug-Free Workplace.\n\nIf you're excited about this role but your experience doesn't align perfectly with every qualification in the job description, consider applying for it anyway! Sedgwick is building a diverse, equitable, and inclusive workplace and recognizes that each person possesses a unique combination of skills, knowledge, and experience. You may be just the right candidate for this or other roles.\n\nTaking care of people is at the heart of everything we do. Caring counts\n\nSedgwick is a leading global provider of technology-enabled risk, benefits and integrated business solutions. Every day, in every time zone, the most well-known and respected organizations place their trust in us to help their employees regain health and productivity, guide their consumers through the claims process, protect their brand and minimize business interruptions. Our more than 30,000 colleagues across 80 countries embrace our shared purpose and values as they demonstrate what it means to work for an organization committed to doing the right thing - one where caring counts. Watch this video to learn more about us. (https://www.youtube.com/watch?v=ywxedjBGSfA) |5.0 |NULL |NULL |NULL |NULL |{\n "lat": 39.7589478,\n "lon": -84.1916069\n} |2024-06-02|2024-07-07|35.0 |
|5a843df632e1ff756fa19d80a0871262d51becc0|sap sd otc consultant us |100173263 |99999 |Full-time (> 32 hours)|[None] |SAP SD/OTC Consultant (US)\nSomerset, NJ - competitive\nContract\nPosted by: Global Enterprise Partners\nPosted: Thursday, 23 May 2024\n\n\n\n\nGlobal Enterprise Partners is currently looking for an SAP SD-OTC Consultant to join an exciting project based in US. This position is located in New Jersey and 50-60% travel is expected to Somerset, NJ/Piscataway, NJ.\n\nResponsibilities\n\nMinimum experience of 7-10 years as a Functional SAP Consultant working on at least one full cycle implementation and supporting Rollout Based projects\nFull Order-To-Cash (OTC) process knowledge: Order Management, Delivery and Billing\nExperience with main order types: Inquiries, Sales Order, Consignment, Quantity Contracts, Customer Returns, Credit/Debit orders\nBasic Functions for SD: Pricing, Material Determination, Outputs/Forms, Account Determination, Credit/Risk Management.\nLE-TRA: basic knowledge of Shipping process, Shipment and Transportation process (incl. Inbound and Outbound Delivery)\nMM-PUR: Basic knowledge of the Purchasing process and STO Process related to Purchasing.\n\nJob Details\n\nStart - June/July 2024\nDuration - 9 months with possibility of extension\nLocation - Somerset, NJ/Piscataway, NJ - 50% travel - Hybrid\n\nInterested? Or do you know someone who might be relevant? Send an updated resume and feel free to reach out to me\n\nLocation\nSomerset, NJ, United States of America\nIndustry\nIT\nDuration\n9 months +\nStart Date\nJuly 2024\nRate\ncompetitive\nEmployment Business\nGlobal Enterprise Partners\nContact\nJames Mountford\nReference\nJS-EP-34296521\nPosted Date\n5/23/2024 5:46:45 AM |7.0 |7.0 |NULL |NULL |NULL |{\n "lat": 41.1220409,\n "lon": -74.5804378\n} |2024-06-02|2024-06-20|18.0 |
|229620073766234e814e8add21db7dfaef69b3bd|sr marketing analyst |39016169 |54151 |Full-time (> 32 hours)|[None] |Sr. Marketing Analyst\nUnited States, NY, New York\nRegular\n5/9/2024\n539163\nAbout our Company:\nMedidata: Powering Smarter Treatments and Healthier People\nMedidata, a Dassault Systmes company, is leading the digital transformation of life sciences, creating hope for millions of people. Medidata helps generate the evidence and insights to help pharmaceutical, biotech, medical device and diagnostics companies, and academic researchers accelerate value, minimize risk, and optimize outcomes. More than one million registered users across 2,000+ customers and partners access the world's most trusted platform for clinical development, commercial, and real-world data. Known for its groundbreaking technological innovations, Medidata has supported more than 30,000 clinical trials and 9 million study participants. Medidata is headquartered in New York City and has offices around the world to meet the needs of its customers. Discover more at www.medidata.com and follow us on LinkedIn, Instagram, and X.\nAbout the Role:\nAs the Sr. Marketing Analyst, your core responsibility is to support Marketing teams by conducting analyses, providing insights and identifying operational enhancements that will improve the efficiency and effectiveness of marketing programs through the marketing funnel. You will interact with various marketing teams, IT and external agencies and provide insights on factors that can help drive business growth, enhance customer identification, increase customer engagement and generate opportunities. You must be a strategic thinker with strong analytical and technical skills and can make recommendations based on data insights.\nResponsibilities:\nCreates weekly, monthly and/or quarterly marketing reports as well as ad hoc analysis on time\nUses a data driven approach to assess campaign performance, develops measurement framework & tracks KPIs, and optimizes future campaign tactics\nLeverages key tools and business knowledge to conduct various analyses and identifies patterns in the data; uses data mining, model building and other analytical techniques to develop and maintain data visualizations\nPerforms exploratory data analyses using first-party, second-party and 3rd party data sources; turns data and analysis into actionable insights and communicates findings for better understanding and buy-in\nIndependently work on analytical projects involving large amounts of data, statistical modeling / machine learning\nPerform and share analyses to guide decision-making and participate in and support interactions within Medidata to collect business requirements and drive analysis buy-in; develop alternative methods of analyzing marketing performance and opportunities for new campaign approaches and techniques\nCoordinate and assist in the analysis design, optimize existing analytical process to improve efficiency and effectiveness\nWork across an interdisciplinary team to prioritize and coordinate tasks, monitor progress and issues, and facilitate team meetings\nTranslate and summarize technical and analytical information for business audiences and develop stories that help address business problems\nQualifications:\nMinimum 2 - 4 years of experience in business analytics, operations, or related role; prior experience within life science or technology industries is a plus but not required\nThe minimum education level required is a Bachelor's degree. Master's degree preferred.\nAcceptable fields of study: Economics, Business Administration, Statistics, Data Science, Computer Science, Marketing, Management Information Systems, Operations Research, Mathematics or related fields\nFamiliarity with analytics concepts such as databases, programming, statistical modeling, machine learning, data visualization\nAdvanced skills in MS Office, specifically PowerPoint, Excel and Word as well as the Google Productivity Suite (Google Sheets, Google Slides, Google Docs)\nExperience with SQL and R, SAS or Python. Also comfortable using Google Analytics and building dashboards in Data Studio and/or Tableau, and have some knowledge of CRM tools such as Salesforce.\nThe salary range posted below refers only to positions that will be physically based in New York City / New Jersey. As with all roles, Medidata sets ranges based on a number of factors including function, level, candidate expertise and experience, and geographic location. Pay ranges for candidates in locations other than New York City / New Jersey, may differ based on the local market data in that region. The base salary pay range for this position is $79,500 to $106,424.\nBase pay is one part of the Total Rewards that Medidata provides to compensate and recognize employees for their work. Most sales positions are eligible for a commission on the terms of applicable plan documents, and many of Medidata's non-sales positions are eligible for annual bonuses. Medidata believes that benefits should connect you to the support you need when it matters most and provides best-in-class benefits, including medical, dental, life and disability insurance; 401(k) matching; flexible paid time off; and 10 paid holidays per year.\nEqual Employment Opportunity:\nIn order to provide equal employment and advancement opportunities to all individuals, employment decisions at Medidata are based on merit, qualifications and abilities. Medidata is committed to a policy of non-discrimination and equal opportunity for all employees and qualified applicants without regard to race, color, religion, gender, sex (including pregnancy, childbirth or medical or common conditions related to pregnancy or childbirth), sexual orientation, gender identity, gender expression, marital status, familial status, national origin, ancestry, age, disability, veteran status, military service, application for military service, genetic information, receipt of free medical care, or any other characteristic protected under applicable law. Medidata will make reasonable accommodations for qualified individuals with known disabilities, in accordance with applicable law.\nApplications will be accepted on an ongoing basis until the position is filled.\nMedidata follows a hybrid office policy in which employees who are hired for an in-person are expected to work on site a certain number of days per week (with the specific in-office days to be designated by your team). On July 8, 2024, such employees will be expected to work on site at least 2 days per week. This will increase to at least 3 days per week beginning January 2, 2025.\n#LI- MW1\n#LI-Hybrid |2.0 |2.0 |92962.0 |79500.0 |106424.0 |{\n "lat": 40.7501,\n "lon": -73.997\n} |2024-06-02|2024-08-01|NULL |
+----------------------------------------+-------------------------------------------+----------+-----------+----------------------+----------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+--------------------+--------------------+--------+-----------+---------+-------------------------------------------------+----------+----------+--------+
only showing top 10 rows
3 Step 2: Create Relational Tables in Spark SQL
Table Industries
# Select and rename columns for the industries relational table
industries = raw_postings.select(
F.col("naics_2022_5").cast("int").alias("industry_id"), # Primary Key
F.col("naics_2022_5"), # NAICS code (string)
F.col("naics_2022_5_name"),
F.col("soc_5"),
F.col("soc_5_name"),
F.col("lot_specialized_occupation_name"),
F.col("lot_occupation_group")
).distinct() # Ensure uniqueness
# Register as temporary SQL view
industries.createOrReplaceTempView("industries")
# Display first 10 rows
industries.show(10, truncate=False)[Stage 3:> (0 + 1) / 1]+-----------+------------+----------------------------------------------------------------------+-------+---------------+-------------------------------+--------------------+
|industry_id|naics_2022_5|naics_2022_5_name |soc_5 |soc_5_name |lot_specialized_occupation_name|lot_occupation_group|
+-----------+------------+----------------------------------------------------------------------+-------+---------------+-------------------------------+--------------------+
|51929 |51929 |Web Search Portals and All Other Information Services |15-2051|Data Scientists|Data Analyst |2311 |
|42482 |42482 |Wine and Distilled Alcoholic Beverage Merchant Wholesalers |15-2051|Data Scientists|Enterprise Architect |2315 |
|54191 |54191 |Marketing Research and Public Opinion Polling |15-2051|Data Scientists|SAP Analyst / Admin |2310 |
|51211 |51211 |Motion Picture and Video Production |15-2051|Data Scientists|Business Analyst (General) |1111 |
|44532 |44532 |Beer, Wine, and Liquor Retailers |15-2051|Data Scientists|Data Analyst |2311 |
|56159 |56159 |Other Travel Arrangement and Reservation Services |15-2051|Data Scientists|Oracle Consultant / Analyst |2310 |
|52229 |52229 |Other Nondepository Credit Intermediation |15-2051|Data Scientists|Oracle Consultant / Analyst |2310 |
|49312 |49312 |Refrigerated Warehousing and Storage |15-2051|Data Scientists|Financial Data Analyst |2311 |
|81321 |81321 |Grantmaking and Giving Services |15-2051|Data Scientists|Enterprise Architect |2315 |
|45521 |45521 |Warehouse Clubs, Supercenters, and Other General Merchandise Retailers|15-2051|Data Scientists|SAP Analyst / Admin |2310 |
+-----------+------------+----------------------------------------------------------------------+-------+---------------+-------------------------------+--------------------+
only showing top 10 rows
Table Companies
# Create the 'companies' table by selecting and deduplicating relevant columns
companies = raw_postings.select(
F.col("company").alias("company_id"), # Primary Key
F.col("company").alias("company"), # Company code
F.col("company_name").alias("company_name"), # Clean name
F.col("company_raw").alias("company_raw"), # Raw name (possibly unprocessed)
F.col("company_is_staffing").alias("company_is_staffing") # Boolean indicator
).dropna(subset=["company"]).dropDuplicates(["company_id"])
# Register as a temporary SQL view
companies.createOrReplaceTempView("companies")
# Show the result
companies.show(10, truncate=False)[Stage 6:> (0 + 1) / 1]+----------+---------+--------------------------------+--------------------------------+-------------------+
|company_id|company |company_name |company_raw |company_is_staffing|
+----------+---------+--------------------------------+--------------------------------+-------------------+
|0 |0 |Unclassified |LH/GM |False |
|100021577 |100021577|University of the Pacific |University of the Pacific |False |
|100021578 |100021578|University of North Florida |UNIVERSITY OF NORTH FLORIDA |False |
|100021586 |100021586|Texas Tech University |Texas Tech University |False |
|100021587 |100021587|University of Nevada |University of Nevada, Las Vegas |False |
|100021589 |100021589|University of Rochester |University of Rochester |False |
|100021593 |100021593|US Tech Solutions |U.S. Tech Solutions Inc. |True |
|100021595 |100021595|Giant Eagle |Giant Eagle |False |
|100021597 |100021597|University of the Incarnate Word|University of the Incarnate Word|False |
|100021601 |100021601|University of Redlands |University of Redlands |False |
+----------+---------+--------------------------------+--------------------------------+-------------------+
only showing top 10 rows
Table Locations
locations = raw_postings.select(
F.col("location").alias("location_id"),
F.col("location"),
F.col("city_name"),
F.col("state_name"),
F.col("county_name"),
F.col("msa"),
F.col("msa_name")
).dropDuplicates()
# Register as a temporary SQL view
locations.createOrReplaceTempView("locations")
# Show result
locations.show(10, truncate=False)[Stage 9:> (0 + 1) / 1]+-------------------------------------------------+-------------------------------------------------+----------------+------------+-------------------+-------+--------------------------------------------+
|location_id |location |city_name |state_name |county_name |msa |msa_name |
+-------------------------------------------------+-------------------------------------------------+----------------+------------+-------------------+-------+--------------------------------------------+
|{\n "lat": 39.6837226,\n "lon": -75.7496572\n} |{\n "lat": 39.6837226,\n "lon": -75.7496572\n} |Newark, DE |Delaware |New Castle, DE |37980.0|Philadelphia-Camden-Wilmington, PA-NJ-DE-MD |
|{\n "lat": 40.0415996,\n "lon": -75.3698895\n} |{\n "lat": 40.0415996,\n "lon": -75.3698895\n} |Wayne, PA |Pennsylvania|Delaware, PA |37980.0|Philadelphia-Camden-Wilmington, PA-NJ-DE-MD |
|{\n "lat": 40.4642335,\n "lon": -80.6009058\n} |{\n "lat": 40.4642335,\n "lon": -80.6009058\n} |Toronto, OH |Ohio |Jefferson, OH |48260.0|Weirton-Steubenville, WV-OH |
|{\n "lat": 39.0992752,\n "lon": -76.8483061\n} |{\n "lat": 39.0992752,\n "lon": -76.8483061\n} |Laurel, MD |Maryland |Prince George's, MD|47900.0|Washington-Arlington-Alexandria, DC-VA-MD-WV|
|{\n "lat": 39.8646455,\n "lon": -86.1039189\n} |{\n "lat": 39.8646455,\n "lon": -86.1039189\n} |Indianapolis, IN|Indiana |Marion, IN |26900.0|Indianapolis-Carmel-Anderson, IN |
|{\n "lat": 39.670937,\n "lon": -75.7080727\n} |{\n "lat": 39.670937,\n "lon": -75.7080727\n} |Newark, DE |Delaware |New Castle, DE |37980.0|Philadelphia-Camden-Wilmington, PA-NJ-DE-MD |
|{\n "lat": 39.5401545,\n "lon": -119.7483949\n}|{\n "lat": 39.5401545,\n "lon": -119.7483949\n}|Sparks, NV |Nevada |Washoe, NV |39900.0|Reno, NV |
|{\n "lat": 43.2286174,\n "lon": -88.1103691\n} |{\n "lat": 43.2286174,\n "lon": -88.1103691\n} |Germantown, WI |Wisconsin |Washington, WI |33340.0|Milwaukee-Waukesha, WI |
|{\n "lat": 47.4234599,\n "lon": -120.3103494\n}|{\n "lat": 47.4234599,\n "lon": -120.3103494\n}|Wenatchee, WA |Washington |Chelan, WA |48300.0|Wenatchee, WA |
|{\n "lat": 33.6469437,\n "lon": -117.6861023\n}|{\n "lat": 33.6469437,\n "lon": -117.6861023\n}|Lake Forest, CA |California |Orange, CA |31080.0|Los Angeles-Long Beach-Anaheim, CA |
+-------------------------------------------------+-------------------------------------------------+----------------+------------+-------------------+-------+--------------------------------------------+
only showing top 10 rows
3.1.1 Save the Industries Table as a CSV File (optional)
industries.write.option("header", "true").mode("overwrite").csv("industries.csv")[Stage 12:> (0 + 1) / 1] industries.createOrReplaceTempView("industries")Get Top 5 Industries with the Most Job Postings
spark.sql("""
SELECT industry_id, COUNT(*) AS job_postings_count
FROM job_postings
WHERE industry_id IS NOT NULL
GROUP BY industry_id
ORDER BY job_postings_count DESC
LIMIT 5
""").show()[Stage 15:> (0 + 1) / 1]+-----------+------------------+
|industry_id|job_postings_count|
+-----------+------------------+
| 54151| 10862|
| 99999| 9493|
| 54161| 6395|
| 56131| 4743|
| 52211| 2044|
+-----------+------------------+
job_postings.printSchema()
industries.printSchema()root
|-- job_id: string (nullable = true)
|-- title_clean: string (nullable = true)
|-- company_id: string (nullable = true)
|-- industry_id: integer (nullable = true)
|-- employment_type_name: string (nullable = true)
|-- remote_type_name: string (nullable = true)
|-- body: string (nullable = true)
|-- min_years_experience: double (nullable = true)
|-- max_years_experience: double (nullable = true)
|-- salary: double (nullable = true)
|-- salary_from: double (nullable = true)
|-- salary_to: double (nullable = true)
|-- location_id: string (nullable = true)
|-- posted: string (nullable = true)
|-- expired: string (nullable = true)
|-- duration: string (nullable = true)
root
|-- industry_id: integer (nullable = true)
|-- naics_2022_5: string (nullable = true)
|-- naics_2022_5_name: string (nullable = true)
|-- soc_5: string (nullable = true)
|-- soc_5_name: string (nullable = true)
|-- lot_specialized_occupation_name: string (nullable = true)
|-- lot_occupation_group: string (nullable = true)
industries.createOrReplaceTempView("industries")job_postings_by_industry = spark.sql("""
SELECT
jp.industry_id AS industry_id,
i.naics_2022_5_name AS industry_name,
COUNT(*) AS job_postings_count
FROM job_postings jp
JOIN industries i
ON jp.industry_id = i.industry_id
WHERE jp.industry_id IS NOT NULL
GROUP BY jp.industry_id, i.naics_2022_5_name
ORDER BY job_postings_count DESC
LIMIT 5
""").show(truncate=False)[Stage 18:> (0 + 1) / 1][Stage 19:> (0 + 1) / 1] +-----------+-----------------------------------------------------------+------------------+
|industry_id|industry_name |job_postings_count|
+-----------+-----------------------------------------------------------+------------------+
|54151 |Computer Systems Design and Related Services |119482 |
|99999 |Unclassified Industry |104423 |
|54161 |Management Consulting Services |70345 |
|56131 |Employment Placement Agencies and Executive Search Services|52173 |
|52211 |Commercial Banking |22484 |
+-----------+-----------------------------------------------------------+------------------+
The largest number of vacancies is in the Computer Systems Design and Related Services category, followed by the Unclassified Industry category. Management consulting and employment agency services also show significant demand, while commercial banking registers the lowest volume among these five sectors. In general, this indicates strong hiring trends for technology-oriented positions.
job_postings_by_industry = spark.sql("""
SELECT
jp.industry_id AS industry_id,
i.naics_2022_5_name AS industry_name,
COUNT(*) AS job_postings_count
FROM job_postings jp
JOIN industries i
ON jp.industry_id = i.industry_id
WHERE jp.industry_id IS NOT NULL
GROUP BY jp.industry_id, i.naics_2022_5_name
ORDER BY job_postings_count DESC
LIMIT 5
""")job_postings_by_industry.write \
.mode("overwrite") \
.option("header", "true") \
.csv("job_postings_by_industry.csv")[Stage 25:> (0 + 1) / 1][Stage 26:> (0 + 1) / 1] 4.1 Query 1: Industry-Specific Salary Trends Grouped by Job Title
Identify median salary trends for job postings in the Technology industry (NAICS_2022_6 = ‘518210’), grouped by specialized occupation.
raw_postings.select(
F.col("id").alias("job_id"),
F.col("title_clean"),
F.col("company").alias("company_id"),
F.col("naics_2022_6").cast("string").alias("industry_id"),
F.col("naics_2022_6_name").alias("industry_name"),
F.col("lot_specialized_occupation_name"),
F.col("salary").cast("double").alias("salary")
).createOrReplaceTempView("job_postings_full")# Register enhanced view with additional fields for SQL analysis
raw_postings.select(
F.col("id").alias("job_id"),
F.col("title_clean"),
F.col("company"),
F.col("naics_2022_6").cast("string").alias("industry_id"),
F.col("naics_2022_6_name").alias("industry_name"),
F.col("lot_specialized_occupation_name"),
F.col("salary").cast("double")
).createOrReplaceTempView("job_postings_full")median_salary_df = spark.sql("""
SELECT
industry_name,
lot_specialized_occupation_name AS specialized_occupation,
PERCENTILE_APPROX(salary, 0.5) AS median_salary
FROM job_postings_full
WHERE industry_id = '518210'
AND salary IS NOT NULL
AND salary > 0
AND lot_specialized_occupation_name IS NOT NULL
GROUP BY industry_name, lot_specialized_occupation_name
ORDER BY median_salary DESC
""")
median_salary_df.show(truncate=False)[Stage 32:> (0 + 1) / 1]+--------------------------------------------------------------------------------------+--------------------------------+-------------+
|industry_name |specialized_occupation |median_salary|
+--------------------------------------------------------------------------------------+--------------------------------+-------------+
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Enterprise Architect |190000.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Marketing Analyst |179250.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Oracle Consultant / Analyst |143000.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|General ERP Analyst / Consultant|133223.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Business Intelligence Analyst |123250.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Data Analyst |110833.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Data Quality Analyst |104000.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|SAP Analyst / Admin |86522.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Business Analyst (General) |86000.0 |
|Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services|Financial Data Analyst |29295.0 |
+--------------------------------------------------------------------------------------+--------------------------------+-------------+
pandas_df = median_salary_df.toPandas()
import plotly.express as px
fig = px.bar(
pandas_df,
y='specialized_occupation',
x='median_salary',
color='specialized_occupation',
orientation='h',
title='Median Salary Trends by Specialized Occupation',
labels={
'specialized_occupation': 'Specialized Occupation',
'median_salary': 'Median Salary ($)'
},
hover_data=['industry_name'],
height=600
)
fig.show()[Stage 35:> (0 + 1) / 1] The position of Enterprise Architect provides the highest average salary, followed by Marketing Analyst with a slight lag. Oracle Consultant/Analyst roles are ranked third, reflecting the high demand for specialized technical knowledge. Meanwhile, Financial Data Analyst shows the lowest average salary among these roles, suggesting the potential for salary growth in this specialization.
4.2 Query 2: Top 5 Companies with the Most Remote Jobs in California
Identify top companies hiring for remote jobs in California, ranked by the number of job postings.
remote_jobs_df = spark.sql("""
SELECT
c.company_name,
COUNT(*) AS remote_jobs
FROM job_postings jp
JOIN companies c ON jp.company_id = c.company_id
JOIN locations l ON jp.location_id = l.location_id
WHERE jp.remote_type_name = 'Remote'
AND l.state_name = 'California'
GROUP BY c.company_name
ORDER BY remote_jobs DESC
LIMIT 5
""")
remote_jobs_df.show(truncate=False)[Stage 43:> (0 + 1) / 1][Stage 44:> (0 + 1) / 1] [Stage 49:> (0 + 1) / 1]+-----------------------+-----------+
|company_name |remote_jobs|
+-----------------------+-----------+
|Unclassified |81 |
|GovCIO |66 |
|Amentum |50 |
|Lincoln Financial Group|42 |
|Smx Corporation Limited|40 |
+-----------------------+-----------+
import seaborn as sns
import matplotlib.pyplot as plt
remote_jobs_pd = remote_jobs_df.toPandas()
plt.figure(figsize=(10, 6))
sns.barplot(
data=remote_jobs_pd,
x='company_name',
y='remote_jobs',
hue='company_name',
palette='coolwarm',
dodge=False,
legend=False
)
# Bar settings
plt.title('Top 5 Companies with the Most Remote Jobs in California', fontsize=14)
plt.xlabel('Company Name')
plt.ylabel('Number of Remote Jobs')
plt.xticks(rotation=45, ha='right')
plt.tight_layout()
plt.show()[Stage 52:> (0 + 1) / 1][Stage 52:> (0 + 1) / 1][Stage 53:> (0 + 1) / 1][Stage 53:> (0 + 1) / 1] [Stage 58:> (0 + 1) / 1] 
“Unclassified” has the largest number of deleted vacancies, which suggests that a significant portion of job ads fall into a broad or undefined category. GovCIO follows with a slight lag, pointing to a strong remote approach in this government-oriented technology field. Amentum, Lincoln Financial Group, and Smc Corporation Limited round out the list with moderate but notable remote work offers in the state.
4.3 Query 3: Monthly Job Posting Trends in California
Identify monthly job posting trends in California, analyzing how job postings fluctuate over time.
monthly_job_trends_df = spark.sql("""
SELECT
YEAR(TO_DATE(jp.posted, 'yyyy-MM-dd')) AS year,
MONTH(TO_DATE(jp.posted, 'yyyy-MM-dd')) AS month,
COUNT(*) AS job_count
FROM job_postings jp
JOIN locations l ON jp.location_id = l.location_id
WHERE l.state_name = 'California'
AND jp.posted IS NOT NULL
GROUP BY
YEAR(TO_DATE(jp.posted, 'yyyy-MM-dd')),
MONTH(TO_DATE(jp.posted, 'yyyy-MM-dd'))
ORDER BY year, month
""")
monthly_job_trends_pd = monthly_job_trends_df.toPandas()
import seaborn as sns
import matplotlib.pyplot as plt
plt.figure(figsize=(12, 6))
sns.lineplot(
data=monthly_job_trends_pd,
x='month',
y='job_count',
hue='year',
marker='o',
palette='tab10'
)
plt.title('Monthly Job Posting Trends in California', fontsize=14)
plt.xlabel('Month', fontsize=12)
plt.ylabel('Number of Job Postings', fontsize=12)
plt.xticks(range(1, 13))
plt.legend(title='Year', loc='upper left')
plt.grid(True, linestyle='--', alpha=0.5)
plt.tight_layout()
plt.show()[Stage 61:> (0 + 1) / 1] [Stage 64:> (0 + 1) / 1] 
The chart shows a significant drop in the number of vacancies from the spring peak to a minimum in July, followed by a gradual recovery in August and September. This pattern suggests a seasonal hiring cycle or, possibly, external factors affecting job availability during the summer months. By the beginning of autumn, the upward trend indicates that employers are starting to increase hiring again, although the levels remain below the initial peak.
4.4 Query 4: Salary Comparisons Across Major US Cities
This query compares average salaries for job postings in selected major metropolitan areas across the US.
salary_by_city_df = spark.sql("""
SELECT
l.msa_name,
ROUND(AVG(jp.salary), 0) AS average_salary,
COUNT(*) AS job_count
FROM job_postings jp
JOIN locations l ON jp.location_id = l.location_id
WHERE jp.salary IS NOT NULL
AND jp.salary > 0
AND l.msa IN (
14460.0, 47900.0, 35620.0, 41860.0, 42660.0,
31080.0, 19100.0, 26420.0, 12420.0, 34980.0,
28140.0, 19740.0
)
GROUP BY l.msa_name
ORDER BY average_salary DESC
""")import seaborn as sns
import matplotlib.pyplot as plt
salary_by_city_pd = salary_by_city_df.toPandas()
plt.figure(figsize=(12, 6))
sns.barplot(
data=salary_by_city_pd,
x='average_salary',
y='msa_name',
palette='Blues_d',
hue='msa_name',
dodge=False,
legend=False
)
plt.title('Average Salary Comparisons Across Major US Metro Areas', fontsize=14)
plt.xlabel('Average Salary ($)')
plt.ylabel('Metro Area')
plt.tight_layout()
plt.show()[Stage 72:> (0 + 1) / 1][Stage 73:> (0 + 1) / 1] 
The highest average salary in San Francisco is Oakland–Berkeley, followed by Seattle–Tacoma–Bellevue. Large coastal metropolitan areas such as Washington and New York also occupy locations near the upper range, while areas such as Los Angeles and Nashville have comparatively lower averages. This suggests that hubs with a technological or financial component usually offer the most competitive compensation.