Intorduction to AWS and Boto

•

1 recomendación•1,603 vistas

Mind the Byte

Introductory talk of Christian Teijón (CTO of Mind the Byte) about Amazon Web Services and Python Boto

Tecnología Empresariales

Introduction to
AMAZON WEB
SERVICES
and
BOTO

@chteijon
@MindtheByte

EC2: Elastic Compute Cloud

@chteijon
@MindtheByte
2

EC2: Elastic Compute Cloud

Boto code:
KEY_ID='AGIAJPPYZBKTWGGX8AHS'
KEY_SECRET='RwXTKmn7Ujfqmdsakcs/MRdf89sdSDffxU8sjRuD'
REGION="us-west-1"

ec2 = boto.connect_ec2( KEY_ID, KEY_SECRET, region=REGION )

reservation = ec2.run_instances( image_id=AMI_ID,
key_name=KEY_HANDLE,
instance_type=INSTANCE_TYPE,
security_groups = [ SGS ] )

@chteijon
@MindtheByte
3

EC2: AMI (Amazon Machine Image)

@chteijon
@MindtheByte
4

EC2: Spot instance

On demand
price: t!
0% oun
9 c
dis

@chteijon
@MindtheByte
5

EC2: Spot instance

Boto code:
ec2 = boto.connect_ec2( KEY_ID, KEY_SECRET, region=REGION )

ec2_conn.request_spot_instances(
price=0.1,
image_id=AMI,
count=1,
key_name=KEY_HANDLE,
security_group_ids=[ SGS ] ,
instance_type= "m1.xlarge",
user_data=userdata )

On demand
price: t!
0% oun
9 c
dis

@chteijon
@MindtheByte
6

S3: Simple storage service

@chteijon
@MindtheByte
7

S3: Simple storage service
Boto code:
# Connect to a bucket
s3conn = boto.s3.connection.S3Connection( KEY_ID, KEY_SECRET )
s3bucket = s3conn.get_bucket(“meetup_python_cloud”)

# Set a key
s3key = boto.s3.key.Key(bucketconn)
s3key.key = “data/file.txt”
s3key.set_contents_from_string(“Some info”,policy=policy)

# Get a key
s3key.key = “data/anotherfile.txt”
value=s3key.get_contents_as_string()

# Delete a key
S3bucket.delete_key(s3key)

@chteijon
@MindtheByte
8

How does all this sum up?

Amazon S3
@chteijon
@MindtheByte
9

How does all this sum up?
AMI

Amazon S3
@chteijon
@MindtheByte
10

How does all this sum up?

Amazon S3
@chteijon
@MindtheByte
11

How does all this sum up?

Amazon S3
@chteijon
@MindtheByte
12

How does all this sum up?

Amazon S3
@chteijon
@MindtheByte
13

Common alternatives to distribute jobs

Amazon RDS :
Relational Dabatase Service

Amazon SQS:
Simple Queue Service

@chteijon
@MindtheByte
14

Key advantatges of the cloud

●
(almost) Infinite computational power
available to speed up your computations

●
Pay-as-you-go, no need of initial
investment or hardware maintenance costs.

@chteijon
@MindtheByte
15

Más contenido relacionado

Similar a Intorduction to AWS and Boto

HPC on AWS

ReadMaloney

Доклад посвящен экосистеме Cortana Analytics Suite, в т.ч. сервису предиктивной аналитики Azure Machine Learning. В demo-части доклада разбирается задача анализа тональности сообщений в социальных сетях. Видео выступления и пояснения к demo-доклада доступно на http://0xcode.in/dev-camp

Machine Learning in Microsoft Azure

Dmitry Petukhov

HPC on AWS

Amazon Web Services

Talk at NCRR P41 Director's Meeting

Deepak Singh

Organizations are spending a lot of money to maintain their business data using legacy Enterprise content management systems [1], tools, hardware support and maintenance, which are not satisfying the consumers. Box is Novel ECM system which allows the users to store, view, search large value of data with lesser bandwidth to increase user experience for modern business. Modern business running on new enterprise cloud platforms like Amazon, eBay, Salesforce. Persistence of business users data is simpler and faster with this platform and is really an emerging solution for the current industry. The real-time integration between cloud SaaS application with on-premises content management systems (SharePoint [2], box [3], Oracle Web Center [4], Nuxeo [5], Open Text [6], Dell Documentum [7], IBM FileNet p8[8], Docushare [9], On Base [10], Laser Fiche [11], SpringCM [12], Seismic [13], Lexmark [14], M-Files [15], Alfresco [16], Media Bank [17], Veeva Vault [18], etc.) In this paper, we are proposing a new paradigm of how Cloud SaaS applications integrate with novel ECMs for modern business. We performed real-time integration from SFDC to box with a business use case, we did bi-directional data synchronization between SFDC to box and vice versa. C. V. Satyanarayana | Dr. P. Suryanarayana Babu"A Novel Secure Cloud SAAS Integration for User Authenticated Information" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-1 | Issue-4 , June 2017, URL: http://www.ijtsrd.com/papers/ijtsrd2227.pdf http://www.ijtsrd.com/computer-science/computer-security/2227/a-novel-secure-cloud-saas-integration-for-user-authenticated-information/c-v-satyanarayana

A Novel Secure Cloud SAAS Integration for User Authenticated Information

ijtsrd

Amazon2009 04 22 Amsterdam

arnoud.wijnands

At re:Invent in 2017 Amazon announced new service – SageMaker, that allows you to build, train and deploy ML models at any scale. Sounds fantastic, but is it true? We challenged the marketing taglines and decided to test a specific use case which is familiar to us: ad targeting. During the workshop, which is an adventure itself, we build an approximation of an ad targeting system with the use of Amazon SageMaker – from development to deployment. We show how with use of such service you can start small and be pretty confident about scaling up and expanding the system later. We start from the ground up, so no worries – there is no need for previous experience with advertising systems and neither AWS, although general knowledge about machine learning or data crunching is a plus. If you were curious after the last year’s re Invent announcement, that is a workshop for you!

Amazon SageMaker in Practice - Workshop at Big Data Moscow 2018 (10.10.2018)

Wojciech Gawroński

Chapter 8

pavan penugonda

최근 데이터의 폭증과 이를 기반한 빅데이터 분석이 기업 비지니스 성패에 큰 영향을 끼치고 있습니다. 다양한 기업의 데이터 기반 의사 결정을 위한 요구를 수용하는 분석 플랫폼과 인공 지능 기술의 도입은 큰 화두입니다. 본 세션에서는 기업의 비지니스 전략 및 기획을 담당하시는 분들을 위해 클라우드 기반 데이터 분석 플랫폼을 쉽게 접근하고 사용할 수 있는 방법을 사례 위주로 소개합니다.국내외 주요 기업들이 어떻게 AWS기반 데이터 분석 및 기계 학습 서비스로 비지니스 혁신에 활용하고 있는지 알아보시기 바랍니다.

데이터 기반 의사결정을 통한 비지니스 혁신 - 윤석찬 (AWS 테크에반젤리스트)

Amazon Web Services Korea

Top 23 Things Not to Do in AWS

Ervan Setiawan

Abstract:- Today's enterprises are not only producing data in high volume but also at high velocity. With velocity comes the need to process the data in real time. To meet the real time needs, we developed and deployed Heron, the next generation streaming engine at Twitter. Heron processes billions and billions of events per day at Twitter and has been in production for nearly 3 years. Heron provides unparalleled performance at large scale and has been successfully meeting Twitter's strict performance requirements for various streaming and iOT applications. Heron is a open source project with several major contributors from various institutions. As the project, we identified and implemented several optimizations that improved throughput by additional 5x and further reduce latency by 50-60%. In this talk, we will describe Heron in detail, how the detailed profiling indicated the performance bottleneck areas such as multiple serializations/deserialization and immutable data structures. After mitigating these costs, we were able to show much higher throughput and latencies as low as 12ms.

Real Time Processing Using Twitter Heron by Karthik Ramasamy

Data Con LA

Blockchain is the currently the hottest tech buzzword. Yet is it just hype or is it that fundamental piece of tech that will it truly change the world we live in, much like the internet did 25 years ago? This presentation initially explains the fundamentals of blockchain and how it enables a new breed of business models. Then we will then delve into how you can have a blockchain app on Azure, followed by a demo. The presention describes analyses Microsoft's strategy with blockchain and how they are working on enabling Azure support to a number of DLTs including Ethereum, Hyperledger Fabric, R3 Corda, Quorum and Chain Core by offering easy-to-deploy templates for these ledgers. And more importantly how Microsoft is integrating these DLTs to the existing rich Azure ecosystem to enable the building of truly scalable, distributed enterprise applications using cryptlets and the Coco Framework.

Blockchain On Azure

Johan Zammit

With the fast pace that technology is moving these days you might see terms such as AI, machine learning, and serverless computing. Ever wonder how you can use these in your development projects? During this session we will cover high level ‘What is ‘serverless’ computing,’ see how to leverage Azure functions with Xamarin, and inject some AI into our functions all initiated from an iOS and Android app. We will work through a sample application built using Xamarin Forms and slowly add features to make our app better! If this interests you make sure to sign up and join us! At the end of this presentation, you’ll walk away with ideas on how to leverage these terms in the headlines and see it’s easy to use them for your advantage!

Azure Functions, AI & Xamarin - How to use the Cloud to Your Advantage

Mark Arteaga

"Growing data is a massive computational challenge across the enterprise. The opportunity to draw insights from huge data sets is wide open, but traditional computing environments often can’t scale to those volumes. In this session, Intel Chief Data Scientist Bob Rogers PhD explains how developers can take advantage of technologies from Intel with the AWS platform. Also in this session, AOL Systems Architect Durga Nemani provides insights into how AOL was able to reduce the time and cost to process massive amounts of clickstream data by leveraging big data technologies in AWS. AOL can process data as fast as possible or as cheaply as possible, depending on the SLA, by choosing the number and types of instances without any changes to the code. Session sponsored by Intel."

(BDT210) Building Scalable Big Data Solutions: Intel & AOL

Amazon Web Services

Activity Recognition

AndreaNapoletani

2018 05 hype lightning talk

Chris Dwan

In this session, we will discuss how you can leverage the new cross-platform AWS Mobile Services to build a highly scalable and reliable mobile app, powered by the AWS cloud. We will explore core functionality like authentication and authorization of users, data synchronization, and back-end infrastructure without the need to manage servers. We'll also talk about understanding your user behavior, engaging your users, and bringing your users back to your app. No matter if you are building the next great social app, or a front-office enterprise mobile app, this session will discuss best practices for building reliable and scalable mobile apps.

Build Your Mobile App Faster with AWS Mobile Services (Part 1 - AWS)

Amazon Web Services

Activity Recognition is a project that aims to recognize your activities like standing, sitting, walking and running in order to keep track of your daily trends. GitHub page https://github.com/riccardo97p/IoT_ActivityRecognition Hackster post https://www.hackster.io/andreanapoletani/activity-recognition-with-genuino-101-and-aws-iot-fbeea2 Authors: Alessandro Giannetti https://www.linkedin.com/in/alessandro-giannetti-2b1864b4/ Andrea Napoletani https://www.linkedin.com/in/andrea-napoletani-aa0b87166/ Riccardo Pattuglia https://www.linkedin.com/in/riccardo-pattuglia-3a09ab182/

Activity Recognition project

AndreaNapoletani

Metaverse and Digital Twins on Enterprise-Public.pdf

湯米吳 Tommy Wu

Smart Grid Analytics: All That Remains to be Ready is You

Lauren Watters

Similar a Intorduction to AWS and Boto (20)

HPC on AWS

Machine Learning in Microsoft Azure

HPC on AWS

Talk at NCRR P41 Director's Meeting

A Novel Secure Cloud SAAS Integration for User Authenticated Information

Amazon2009 04 22 Amsterdam

Amazon SageMaker in Practice - Workshop at Big Data Moscow 2018 (10.10.2018)

Chapter 8

데이터 기반 의사결정을 통한 비지니스 혁신 - 윤석찬 (AWS 테크에반젤리스트)

Top 23 Things Not to Do in AWS

Real Time Processing Using Twitter Heron by Karthik Ramasamy

Blockchain On Azure

Azure Functions, AI & Xamarin - How to use the Cloud to Your Advantage

(BDT210) Building Scalable Big Data Solutions: Intel & AOL

Activity Recognition

2018 05 hype lightning talk

Build Your Mobile App Faster with AWS Mobile Services (Part 1 - AWS)

Activity Recognition project

Metaverse and Digital Twins on Enterprise-Public.pdf

Smart Grid Analytics: All That Remains to be Ready is You

Más de Mind the Byte

Aleida Alcaide, European cloud partnership. Iniatives of the European Public ...

Mind the Byte

Service and Support for Science IT-Peter Kunzst, University of Zurich

Mind the Byte

Progress towards security in the Cloud-Héctor Sánchez, Microsoft

Mind the Byte

IP strategies to protect your cloud technology-Florian Michalek, Bardehele Pa...

Mind the Byte

Shared Clinical History of Catalonia-Ignasi Garcia-Milà, Fundació TICSalut

Mind the Byte

Introduction to cloud computing

Mind the Byte

Más de Mind the Byte (7)

Aleida Alcaide, European cloud partnership. Iniatives of the European Public ...

Service and Support for Science IT-Peter Kunzst, University of Zurich

Progress towards security in the Cloud-Héctor Sánchez, Microsoft

IP strategies to protect your cloud technology-Florian Michalek, Bardehele Pa...

Shared Clinical History of Catalonia-Ignasi Garcia-Milà, Fundació TICSalut

Introduction to cloud computing

Mind the Byte

Último

AWS Community Day CPH - Three problems of Terraform

Andrey Devyatkin

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

The 7 Things I Know About Cyber Security After 25 Years | April 2024

Rafal Los

What are drone anti-jamming systems? The drone anti-jamming systems and anti-spoof technology protect against interference, jamming, and spoofing of the UAVs. To protect their security, countries are beginning to research drone anti-jamming systems, also known as drone strike weapons. The anti-jam and anti-spoof technology protects against interference, jamming and spoofing. A drone strike weapon is a drone attack weapon that can attack and destroy enemy drones. So what is so unique about this amazing system?

What Are The Drone Anti-jamming Systems Technology?

Antenna Manufacturer Coco

Scaling API-first – The story of a global engineering organization

Radu Cotescu

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Finology Group – Insurtech Innovation Award 2024

The Digital Insurer

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Safe Software

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

Discord is a free app offering voice, video, and text chat functionalities, primarily catering to the gaming community. It serves as a hub for users to create and join servers tailored to their interests. Discord’s ecosystem comprises servers, each functioning as a distinct online community with its own channels dedicated to specific topics or activities. Users can engage in text-based discussions, voice calls, or video chats within these channels. Understanding Discord Servers Discord servers are virtual spaces where users congregate to interact, share content, and build communities. Servers may revolve around gaming, hobbies, interests, or fandoms, providing a platform for like-minded individuals to connect. Communication Features Discord offers a range of communication tools, including text channels for messaging, voice channels for real-time audio conversations, and video channels for face-to-face interactions. These features facilitate seamless communication and collaboration. What Does NSFW Mean? The acronym NSFW stands for “Not Safe For Work,” indicating content that may be inappropriate for professional or public settings. NSFW Content NSFW content encompasses material that is sexually explicit, violent, or otherwise graphic in nature. It often includes nudity, profanity, or depictions of sensitive topics.

Understanding Discord NSFW Servers A Guide for Responsible Users.pdf

UK Journal

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

[2024]Digital Global Overview Report 2024 Meltwater.pdf

hans926745

Tech Trends Report 2024 Future Today Institute.pdf

hans926745

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Intorduction to AWS and Boto

1. Introduction to AMAZON WEB SERVICES and BOTO @chteijon @MindtheByte

2. EC2: Elastic Compute Cloud @chteijon @MindtheByte 2

3. EC2: Elastic Compute Cloud Boto code: KEY_ID='AGIAJPPYZBKTWGGX8AHS' KEY_SECRET='RwXTKmn7Ujfqmdsakcs/MRdf89sdSDffxU8sjRuD' REGION="us-west-1" ec2 = boto.connect_ec2( KEY_ID, KEY_SECRET, region=REGION ) reservation = ec2.run_instances( image_id=AMI_ID, key_name=KEY_HANDLE, instance_type=INSTANCE_TYPE, security_groups = [ SGS ] ) @chteijon @MindtheByte 3

4. EC2: AMI (Amazon Machine Image) @chteijon @MindtheByte 4

5. EC2: Spot instance On demand price: t! 0% oun 9 c dis @chteijon @MindtheByte 5

6. EC2: Spot instance Boto code: ec2 = boto.connect_ec2( KEY_ID, KEY_SECRET, region=REGION ) ec2_conn.request_spot_instances( price=0.1, image_id=AMI, count=1, key_name=KEY_HANDLE, security_group_ids=[ SGS ] , instance_type= "m1.xlarge", user_data=userdata ) On demand price: t! 0% oun 9 c dis @chteijon @MindtheByte 6

7. S3: Simple storage service @chteijon @MindtheByte 7

8. S3: Simple storage service Boto code: # Connect to a bucket s3conn = boto.s3.connection.S3Connection( KEY_ID, KEY_SECRET ) s3bucket = s3conn.get_bucket(“meetup_python_cloud”) # Set a key s3key = boto.s3.key.Key(bucketconn) s3key.key = “data/file.txt” s3key.set_contents_from_string(“Some info”,policy=policy) # Get a key s3key.key = “data/anotherfile.txt” value=s3key.get_contents_as_string() # Delete a key S3bucket.delete_key(s3key) @chteijon @MindtheByte 8

9. How does all this sum up? Amazon S3 @chteijon @MindtheByte 9

10. How does all this sum up? AMI Amazon S3 @chteijon @MindtheByte 10

11. How does all this sum up? Amazon S3 @chteijon @MindtheByte 11

12. How does all this sum up? Amazon S3 @chteijon @MindtheByte 12

13. How does all this sum up? Amazon S3 @chteijon @MindtheByte 13

14. Common alternatives to distribute jobs Amazon RDS : Relational Dabatase Service Amazon SQS: Simple Queue Service @chteijon @MindtheByte 14

15. Key advantatges of the cloud ● (almost) Infinite computational power available to speed up your computations ● Pay-as-you-go, no need of initial investment or hardware maintenance costs. @chteijon @MindtheByte 15

Intorduction to AWS and Boto

Recomendados

Recomendados

Más contenido relacionado

Similar a Intorduction to AWS and Boto

Similar a Intorduction to AWS and Boto (20)

Más de Mind the Byte

Más de Mind the Byte (7)

Último

Último (20)

Intorduction to AWS and Boto