AWS | Scaling with Amazon ECS

Knoldus

In my last post regarding AWS, I had explained how to launch Amazon ECS cluster including cloud formation, VPC and subnet creation,  ELB and ECS security group creation, auto scaling group, launch configuration, elastic load balancer creation with the help of sample app by creating a task definition, scheduling tasks and configuring a cluster through Amazon ECS First Run Wizard.

In this blog, I will talk about auto scaling means how to

  • Scale in / scale out EC2 instance in a cluster.
  • Scale in / scale out containers(tasks) for a particular service.

Auto scaling is very helpful, as configuring EC2 instance in a auto scaling group or deploying and managing different containers of a same micro service manually is a lot complicated. It can take a lot of time and efforts to do that, but Amazon EC2 Container Service make it easier as it provide one click auto scaling…

View original post 269 more words

Advertisements

Walk through – Amazon ECS First Run Wizard

Knoldus

In my last post, I had explained what is Amazon ECS? Its features and about the main components that are required to start using Amazon EC2 Container Service.

In this blog, I will give you a walk-through of launching EC2 container instances through Amazon ECS First Run Wizard, in which I will deploy the sample application provided by Amazon. We can start using Amazon ECS by creating a task definition, scheduling tasks, and configuring a cluster through Amazon ECS First Run Wizard.

1. Create a task definition

The task definition is a text file, in JSON format, describing the containers that together form an application. Within a Task Definition you can specify one or more containers required for your task, including the Docker repository and image, memory and CPU requirements, shared data volumes, and how the containers are linked to each other.

Task definitions created in the…

View original post 428 more words

2017 – Year of FAST Data

Knoldus

As we approach 2017, there is a strong focus on Fast Data. This is a combination of data at rest and data in motion and the speed has to be remarkably fast. In the deck that follows, we at Knoldus present to you how we have implemented a complex multi scale solution for a large bank on the Fast Data Architecture philosophy. As we partner with Databricks, Lightbend, Confluent and Datastax, we bring in the best practices and tooling needed for the platform.

Just think about it, if Google was always indexing and giving you results from the data at rest then you would never be able to Google for breaking or trending news!

As you enjoy the deck below, we would standby to listen from you on your next fast data project. Have a wonderful New Year 2017

hny2017

View original post

Introduction to Amazon EC2 Container service

Knoldus

What is Amazon ECS (EC2 Container Service)?

Amazon EC2 Container Service (ECS) is a highly scalable, high performance container management service that supports containers and allows you to easily run and manage Docker enabled applications across a cluster of Amazon EC2 instances.

And now you guys are thinking, but what does that mean?
It means that the same Docker containers that you currently use will run exactly the same on Amazon ECS. It eliminate the need to install, operate and scale your own cluster management infrastructure and handles the complexity of running multiple containers like where in the cluster to schedule the container, availability, scalability and monitoring. Amazon ECS lets you launch and stop container-based applications with simple API calls, allows you to get the state of your cluster from a centralized service, and gives you access to many familiar Amazon EC2 features.

View original post 512 more words

Finding the Impact of a Tweet using Spark GraphX

Knoldus

Social Network Analysis (SNA), a process of investigating social structures using Networks and Graphs, has become a very hot topic nowadays. Using it, we can answer many questions like:

  • How many connections an individual have ?
  • What is the ability of an individual to influence a network?
  • and so on…

Which can be used for conducting marketing research studies, running ad campaigns, and finding out latest trends. So, it becomes very crucial to identify the impact of an individual or individuals in a social network, so that we can identify key individuals, or Alpha Users (term used in SNA), in a social network.

In this post we are going to see how to find the impact of an individual in a Social Network like Twitter, i.e., How many Twitter Users an individaul can influence via his/her Tweet upto N number of level, i.e., Followers of Followers of Followers… and so on. For, this…

View original post 572 more words

Lambda Architecture with Spark

Hello folks,

Knoldus  organized a knolx session on the topic : Lambda Architecture with Spark.

The presentation covers lambda architecture and implementation with spark.In the presentaion we will discuss components of lambda architecure like batch layer,speed layer and serving layer.We will also discuss it’s advantages and benefits with spark.

You can watch the video of presentation :

Here you can check slide :

Thanks !!


KNOLDUS-advt-sticker

Neo4j vs ElasticSearch & Full Text Search In Neo4j

Knoldus

Hello Graphistas,

Are you missing this series 🙂 ?

Welcome back again in the series of Neo4j with Scala 😉 . Let’s start our journey again. Till now we have talked and learnt about the use of Neo4j with Scala and how easily we can integrated both two amazing technologies.

Before starting the blog here is recap :

  1. Getting Started Neo4j with Scala : An Introduction
  2. Neo4j with Scala: Defining User Defined Procedures and APOC
  3. Neo4j with Scala: Migrate Data From Other Database to Neo4j
  4. Neo4j with Scala: Awesome Experience with Spark

ElasticSearch is a modern search and analytic engine based on Apache Lucene. ElasticSearch is a full-text search engine and is highly scalable. It allows RESTful web interface and schema-free documents. ElasticSearch is able to achieve fast search responses because it searches an index instead of searching the text directly. ElasticSearch also provides the capability of store data…

View original post 539 more words