Walk through – Amazon ECS First Run Wizard

Knoldus

In my last post, I had explained what is Amazon ECS? Its features and about the main components that are required to start using Amazon EC2 Container Service.

In this blog, I will give you a walk-through of launching EC2 container instances through Amazon ECS First Run Wizard, in which I will deploy the sample application provided by Amazon. We can start using Amazon ECS by creating a task definition, scheduling tasks, and configuring a cluster through Amazon ECS First Run Wizard.

1. Create a task definition

The task definition is a text file, in JSON format, describing the containers that together form an application. Within a Task Definition you can specify one or more containers required for your task, including the Docker repository and image, memory and CPU requirements, shared data volumes, and how the containers are linked to each other.

Task definitions created in the…

View original post 428 more words

2017 – Year of FAST Data

Knoldus

As we approach 2017, there is a strong focus on Fast Data. This is a combination of data at rest and data in motion and the speed has to be remarkably fast. In the deck that follows, we at Knoldus present to you how we have implemented a complex multi scale solution for a large bank on the Fast Data Architecture philosophy. As we partner with Databricks, Lightbend, Confluent and Datastax, we bring in the best practices and tooling needed for the platform.

Just think about it, if Google was always indexing and giving you results from the data at rest then you would never be able to Google for breaking or trending news!

As you enjoy the deck below, we would standby to listen from you on your next fast data project. Have a wonderful New Year 2017

hny2017

View original post

Introduction to Amazon EC2 Container service

Knoldus

What is Amazon ECS (EC2 Container Service)?

Amazon EC2 Container Service (ECS) is a highly scalable, high performance container management service that supports containers and allows you to easily run and manage Docker enabled applications across a cluster of Amazon EC2 instances.

And now you guys are thinking, but what does that mean?
It means that the same Docker containers that you currently use will run exactly the same on Amazon ECS. It eliminate the need to install, operate and scale your own cluster management infrastructure and handles the complexity of running multiple containers like where in the cluster to schedule the container, availability, scalability and monitoring. Amazon ECS lets you launch and stop container-based applications with simple API calls, allows you to get the state of your cluster from a centralized service, and gives you access to many familiar Amazon EC2 features.

View original post 512 more words

Finding the Impact of a Tweet using Spark GraphX

Knoldus

Social Network Analysis (SNA), a process of investigating social structures using Networks and Graphs, has become a very hot topic nowadays. Using it, we can answer many questions like:

  • How many connections an individual have ?
  • What is the ability of an individual to influence a network?
  • and so on…

Which can be used for conducting marketing research studies, running ad campaigns, and finding out latest trends. So, it becomes very crucial to identify the impact of an individual or individuals in a social network, so that we can identify key individuals, or Alpha Users (term used in SNA), in a social network.

In this post we are going to see how to find the impact of an individual in a Social Network like Twitter, i.e., How many Twitter Users an individaul can influence via his/her Tweet upto N number of level, i.e., Followers of Followers of Followers… and so on. For, this…

View original post 572 more words

Lambda Architecture with Spark

Hello folks,

Knoldus  organized a knolx session on the topic : Lambda Architecture with Spark.

The presentation covers lambda architecture and implementation with spark.In the presentaion we will discuss components of lambda architecure like batch layer,speed layer and serving layer.We will also discuss it’s advantages and benefits with spark.

You can watch the video of presentation :

Here you can check slide :

Thanks !!


KNOLDUS-advt-sticker

Neo4j vs ElasticSearch & Full Text Search In Neo4j

Knoldus

Hello Graphistas,

Are you missing this series 🙂 ?

Welcome back again in the series of Neo4j with Scala 😉 . Let’s start our journey again. Till now we have talked and learnt about the use of Neo4j with Scala and how easily we can integrated both two amazing technologies.

Before starting the blog here is recap :

  1. Getting Started Neo4j with Scala : An Introduction
  2. Neo4j with Scala: Defining User Defined Procedures and APOC
  3. Neo4j with Scala: Migrate Data From Other Database to Neo4j
  4. Neo4j with Scala: Awesome Experience with Spark

ElasticSearch is a modern search and analytic engine based on Apache Lucene. ElasticSearch is a full-text search engine and is highly scalable. It allows RESTful web interface and schema-free documents. ElasticSearch is able to achieve fast search responses because it searches an index instead of searching the text directly. ElasticSearch also provides the capability of store data…

View original post 539 more words

What would kill Uber, Airbnb, TripAdvisor in one go?

Knoldus

What do Uber, Airbnb, TripAdvisor, PayPal etc have in common. Right, they are super successful and highly valued and …. ?

Uber and Airbnb fall in the category of Shared Economy. Paypal has changed the way financial transactions are carried out and TripAdvisor makes the rating and booking of hotels and trips easier. So, what is the common theme? The common theme is that all of these are centralised, they control (we can debate this) what gets published and who gets the maximum attention (we can debate this as well). So say Airbnb decides tomorrow that person X in San Francisco should get better hits than person Y then they have the potential to do that. Again, I am not way suggesting that they are doing this but they do have the right (well, err ..?) and the potential because there are like a central authority now. For that matter…

View original post 600 more words