https://dream.weekday.works/redirectToHiringCopilotExtension/

Designed and developed a security framework using AWS Lambda and DynamoDB to provide fine-grained access control to objects in AWS S3.
Developed AWSLambda functions with Boto3 to automate the deregistration of unused Amazon Machine Images (AMIs) in all application regions, reducing EC2 resource costs.
Conducted end-to-end architecture and implementation assessments of AWS services such as Amazon EMR, Redshift, and S3.
Implemented machine learning algorithms using Python to perform predictions by leveraging Kinesis Firehose and S3 data lake.
Utilized AWS EMR to efficiently transform and move large volumes of data between different AWS data stores and databases, such as Amazon S3 and Amazon DynamoDB.
Implemented AWS Step Functions to automate and orchestrate tasks related to Amazon Sage Maker, such as data publishing to S3, model training, and deployment for prediction.
Integrated Apache Airflow with AWS to monitor multi-stage machine learning workflows with tasks running on Amazon Sage Maker.
Developed and scheduled Airflow DAGs to automate the execution of ingestions and ETL jobs.
Successfully migrated the Django database from SQLite to MySQL to PostgreSQL and Designed, developed, and deployed CSV Parsing using the big data approach on AWS EC2.
Implemented object-oriented Python programming, Multithreading, Django, MySQL, exception handling, and Collections in various projects.
Designed and developed applications using the Django MVC Framework, following the MVC design pattern.
Developed consumer-based features and applications using Python, Django, HTML, Behavior Driven Development (BDD), and pair-based programming.
Performed various grid operations using Pandas, Flask, and SQL Alchemy.
Developed Python scripts for parsing XML documents and loading the data into a database. 
queried and managedMySQL database from Python using Python-MySQL connector package and pandas dataframes.

AirTree

Vulcan Capital

The Charles Schwab Corporation (CSC) is a savings and loan holding company. The Company, through its subsidiaries, engages in wealth management, securities brokerage, banking, asset management and financial advisory services. The Company provides financial services to individuals and institutional clients. In 2021, the company recorded annual revenues of $18.98B and a net profit of $5.77B

Worked with Azure Data Factory to integrate data from on-premises sources (such as MySQL and Cassandra) and cloud sources (such as Blob storage and Azure SQL DB), applying transformations and loading the data back into Azure Synapse.
Managed and configured resources across the cluster using Azure Kubernetes Service, monitoring the Spark cluster using Log Analytics and Ambari Web UI. Transitioned log storage from Cassandra to Azure SQL Data Warehouse, resulting in improved query performance.
Developed data ingestion pipelines on Azure HDInsight Spark cluster using Azure Data Factory and Spark SQL. Also worked with Cosmos DB using SQL API and Mongo API.
Worked extensively with Azure Data Factory, including data transformations, Integration Runtimes, Azure Key Vaults, triggers, and migrating data factory pipelines to higher environments using ARM Templates.
Created pipelines to load data from Azure Data Lake into Staging SQLDB and then into Azure SQL DB.
Performed migration of large datasets to Databricks (Spark), including cluster administration, data loading, and configuration of data pipelines from ADLS Gen2 to Databricks using ADF pipelines.
Leveraged Sonarqube's static code analysis capabilities to optimize performance and enhance the efficiency of Python projects.
We have implemented best practices and recommendations from SonarQube reports to significantly reduce code defects and enhance software reliability.
Collaborated with cross-functional teams to integrate SonarQube into the development workflow, promoting a culture of continuous code improvement and software excellence.
Wrote Jenkins file as pipeline as code using Groovy scripting.
Worked on Groovy Script multiple stages to deploy the application in lower environments. 
Created quality gates in the SonarQube dashboard and enforced them in the pipelines to fail the builds when conditions were not met. 
Set up sonar lint, and Codi scope plug-ins in Developer’s workstation.

Possess hands-on experience in Google Cloud Platform (GCP) and its services, including Big Query, Google Cloud Storage (GCS) bucket, Google Cloud Functions, Cloud Dataflow, Data Proc, and Stack driver.
Possess experience in building Power BI reports on Azure Analysis Services to optimize performance.
Utilized Cloud Shell SDK in Google Cloud Platform (GCP) to configure services such as Data Proc, Storage, and Big Query.
Developed Power BI reports leveraging Azure Analysis Services to optimize performance and enhance data analysis capabilities using Big Query.
Utilized PyUnit as the unit test framework for all Python applications and accessed database objects using Django Database APIs.
Worked with MVW frameworks such as Django, AngularJS, HTML, CSS, XML, JavaScript, jQuery, and Bootstrap for designing, coding, and developing Python-based applications using the Django MVC pattern.
Created and modified web services and stored procedures using Python.
Experienced in Shell, Python, and Groovy scripting for automation.
Utilized SonarQube for automated code analysis, identifying and addressing code issues, bugs, and security vulnerabilities in Python applications.
Conducted thorough code reviews using SonarQube to ensure adherence to coding standards, resulting in improved overall code quality and maintainability.
Created nightly builds with integration to code quality tools such as SonarQube, 
Created quality gates in the SonarQube dashboard and enforced them in the pipelines to fail the builds when conditions were not met.
Written some Groovy scripts for setting up LDAP configuration for Jenkins using a security matrix.
Created Jenkins file pipeline as code for CICD deployment using Groovy scripting. Integrated Jenkins with Gitlab for code commits, trigger builds, and poll SCM.

Sawtooth Solutions

Argo Partners

iStart Rajasthan

Black Capital Investments

Target is one of the world’s most recognized brands and one of America’s leading retailers. We make Target our guests’ preferred shopping destination by offering outstanding value, inspiration, innovation and an exceptional guest experience that no other retailer can deliver. Target is committed to responsible corporate citizenship, ethical business practices, environmental stewardship and generous community support. Since 1946, we have given 5 percent of our profits back to our communities. Our goal is to work as one team to fulfill our unique brand promise to our guests, wherever and whenever they choose to shop.

For more information, visit Target.com/Pressroom and ABullseyeView.com. For more on what it's like to be a team member, check out Pulse.Target.com.

Manufacturer & infrastructure fund focused on cannabis based products

Utilized Python libraries for tasks such as web scraping with Beautiful Soup, performing complex calculations using NumPy, SciPy, Matplotlib, and Pandas, and creating graphical user interfaces (GUIs) with Tkinter.
Wrote Python scripts by utilizing Pandas, to parse and load data from JSON files into databases. 
Implemented programs using NumPy and SQL Alchemy to calculate performance metrics. 
Created a template webpage that displays REST API's get and post methods based on user search criteria.
Worked with both WAMP and LAMP architectures.
Built web applications following the Model-View-Controller (MVC) architecture and utilized RESTful and SOAP web services.
Developed data-driven applications using Python 2.7 and Python 3.0, primarily using PyCharm and Anaconda Spyder IDEs.
Used Python and Django to interface with the jQuery UI and manage the storage and deletion of content.
Developed CRUD applications using the MERN stack (MongoDB, Express, ReactJS, and NodeJS) and REST-based APIs.
Conducted data analysis and profiling to identify key join relationships, assess data types, and evaluate data quality using SQL queries.
Implemented a Lambda function to trigger the AWS Glue job based on the defined S3 event.
Configured monitors, alarms, notifications, and logs for Lambda functions and Glue Jobs using CloudWatch.
Utilized AWS Glue catalog with crawler to extract data from S3 and performed SQL query operations using AWS Athena.
Created external tables with partitions using AWS Athena and Redshift for optimized data storage and retrieval.
Designed and developed ETL processes using AWS Glue to migrate Campaign data from external sources like S3, Parquet/Text Files into AWS Redshift.
Worked with Spark ecosystem using Scala and HIVE Queries on different data formats like Text file and parquet.
Utilized Spark API over Cloudera and Hortonworks Hadoop YARN for performing data analytics on Hive.

Designed and transformed layers to write the ETL using Scala and Spark and distributed them among the team.
Designed and developed Spark jobs with Scala to implement an end-to-end data pipeline for batch processing.
Developed servlets for handling auto-upgrade requests from java, .net agents and designed the controller and router modules by implementing MVC framework using AngularJS and node JS.
Loaded Salesforce data on an incremental basis to BigQuery raw and UDM layer using SOQL, Google DataProc, GCS bucket, HIVE, Python, Gsutil, and Shell Script.
Worked with automation tools like Jenkins, Artifactory, SonarQube Chef, and Puppet for the continuous integration and continuous delivery (CI/CD) for implementing end-to-end automation tasks.
Utilized Rest API with python for ingesting data into BigQuery.
Built a program with Python and Apache Beam and executed it in Cloud Dataflow to run data validation between raw source files and BigQuery tables.
Developed web-based applications using Python, Django, Flask, PHP, C++, XML, HTML, JavaScript and developed consumer-based features using Test driven Development (TDD).
Developed a module for building Django ORM Queries which is useful for pre-loading the data.
Monitored BigQuery, Dataproc, and Cloud Dataflow jobs via Stackdriver for all environments.
Utilized G-cloud function with Python to load data into BigQuery for on-arrival CSV files in GCS bucket and analyzed various types of raw files like JSON, CSV,XML with Python using Pandas, Numpy, etc.
Processed and loaded bound and unbound data from Google Pub/Subtopic to BigQuery using Cloud Dataflow with Python.
Utilized Python library Matplotlib for creating charts, graphs and Pickle, Python-twitter, Pandas, Urllib2,BeautifulSoup for database connectivity and used NLTK for processing text data.
Deployed the project into Heroku and Worked with version control tools such as GitHub, and AWS code commit.

gov.il

Inverness Medical Innovations

Apex Venture Partners

Reference Capital Management

Provider of materials management solutions for organizations. The platform has broad expertise in medical imaging, information technologies, medical diagnostics, patient monitoring systems, drug discovery, biopharmaceutical manufacturing technologies, and performance improvement solutions, and more.

Provider of materials management solutions for organizations