공부하고 기록하는, 경제학과 출신 개발자의 노트

학습일지 203

AWS Cloud Solutions Architect - Introduction to Designing Data Lakes on AWS (3). Introduction to Data Lakes

https://www.coursera.org/professional-certificates/aws-cloud-solutions-architect AWS Cloud Solutions Architect Amazon Web Services에서 제공합니다. Start here to become an AWS Solutions Architect. Gain the skills and knowledge to design architectural solutions on ... 무료로 등록하십시오. www.coursera.org Introduction to Data lakes Data Lake가 필요한 대표적인 시나리오는 아래와 같다. 예컨대 startup의 System Administrator라고 가정해보자. 목표는 E..

AWS Cloud Solutions Architect - Architecting Solutions on AWS (2). Designing a solution following account governance and management best practice

https://www.coursera.org/professional-certificates/aws-cloud-solutions-architect AWS Cloud Solutions Architect Amazon Web Services에서 제공합니다. Start here to become an AWS Solutions Architect. Gain the skills and knowledge to design architectural solutions on ... 무료로 등록하십시오. www.coursera.org Customer #4 - requirements 모든 서비스가 하나의 AWS Account (prod account) 내에 구성돼 있음. divide big single account into s..

KubeCon 2020 - Kubernetes Leader Election for Fun and Profit

Kubernetes Leader Election for Fun and Profit Nick Young, VMware 소개할 내용은 세 가지 What is Leader Election & how do you implement Guides for using it Common Patterns What is Leader Election k8s는 API server에서 쓰는 leader election code를 사용자의 controller에서도 쓸 수 있게 지원하고 있다. Elect 1 instance as a leader. only 1 instance can make changes. 사용할 수 있는 기능으로는 write changes back = Controller Pattern 클러스터 외부에서 작업을 수행..

kubernetes Dynamic Informers with client-go

Watching Kubernetes custom resources with dynamic informers & golang https://youtu.be/fBY8sVVjM2s k8s Operator를 만들 때, CRD의 reconcile 로직을 적용하기 위해 Get / List Loop를 쓰는 경우가 있다. ineffective / slow way to find changes. 예컨대 리소스가 backoff 상태라면 Get / List 요청을 보내는 주기가 갈수록 느려진다. 리소스가 많을 경우 pagination 등... 고려할 것들이 늘어남 client go에서 제공하는 (shared) cache를 사용해서 보완하기도 함 위의 방식들보다 더 나은, InformerFactory를 사용해서 Watcher를..

AWS Cloud Solutions Architect - Architecting Solutions on AWS (2). Designing a hybrid solution for container based workloads on AWS

https://www.coursera.org/professional-certificates/aws-cloud-solutions-architect AWS Cloud Solutions Architect Amazon Web Services에서 제공합니다. Start here to become an AWS Solutions Architect. Gain the skills and knowledge to design architectural solutions on ... 무료로 등록하십시오. www.coursera.org Designing a hybrid solution for container based workloads on AWS Customer #3 - requirements 전체 workload의 절반은 ..

AWS re:invent 2020 - AWS X-Ray & Amazon CloudWatch: Increasing visibility for ECS & Fargate

AWS X-Ray & Amazon CloudWatch: Increasing visibility for ECS & Fargatehttps://youtu.be/qXLsx4r37_0 Vanguard: 전세계 170여개 국, 3천만 investors에게 Mutual Fund / ETF 판매하고 Financial advice 제공하는 회사.2019년 경 AWS ECS on Fargate로 MicroService 도입. underlying infra 고민 없이 high performace application / business logic 구현에 신경쓸 수 있도록Vanguard에서 legacy로 사용하던 monitoring / logging tool의 Leverage...cloud-native Observabili..

EuroPython 2022 - From Pip to Poetry: Python ways of packaging and publishing

https://youtu.be/KlvOIuifE5cFrom pip to poetry - Python ways of packaging and publishing발표자: Vinícius Gubiani FerreiraQA Senior Analyst at Azion (Security | Cells Squads)Python Backend Engineer로 오래 일했다고 함 Package ManagersPackage Manager: Configuration Management을 위한 tool.Configuration Management: System Engineering process for establishing consistence of our products attributes through its lifet..

AWS Cloud Solutions Architect - Architecting Solutions on AWS (2). Designing Serverless Data Analytics on AWS

https://www.coursera.org/professional-certificates/aws-cloud-solutions-architect AWS Cloud Solutions Architect Amazon Web Services에서 제공합니다. Start here to become an AWS Solutions Architect. Gain the skills and knowledge to design architectural solutions on ... 무료로 등록하십시오. www.coursera.org Designing a serverless data analytics solution on AWS Customer #2 - SW House Customer Requirement 현재 S3 Stati..

AWS Cloud Solutions Architect - Architecting Solutions on AWS (2). Designing Serverless Web Backend on AWS

https://www.coursera.org/professional-certificates/aws-cloud-solutions-architect AWS Cloud Solutions Architect Amazon Web Services에서 제공합니다. Start here to become an AWS Solutions Architect. Gain the skills and knowledge to design architectural solutions on ... 무료로 등록하십시오. www.coursera.org Designing a serverless web backend on AWS Solution Architect가 되었다고 가정하고, customer의 요구사항에 맞게 어떤 AWS Service를 어..

istioCon 2022 - Egress Woes: Debugging External service Traffic in istio

Egress Woes: Debugging external service traffic in Istio https://youtu.be/opLiXzkseCI 발표자료: https://events.istio.io/istiocon-2022/slides/f5b-EgressWoes.pdf VirtualService, DestinationRule, ServiceEntry 등을 만들었다. 그럼 failed Communication을 확인하고 로그 보는 것도 필요함. debugging 관련 내용은 이미 많이 알려져 있으니 Few Common mistakes regarding External Service Traffic을 소개하려 함. 1. istioctl ps / istioctl analyze 써라 일반적으로 faile..