We use proprietary and third party´s cookies to improve your experience and our services, identifying your Internet Browsing preferences on our website; develop analytic activities and display advertising based on your preferences. If you keep browsing, you accept its use. You can get more information on our Cookie Policy
Cookies Policy
Ask Your Question
0

Requirements to implement several enablers

asked 2016-06-27 14:47:22 +0200

blackbit gravatar image

Hi, We are a startup, that is adopting several enablers : Cosmos, CKAN, Keyrock, POI, Wirecloud, and we are currently using virtual machines from Fiware labs, for CKAN, Keyrock & POI. But for cosmos we are using the fiware cloud servers (cosmos.lab.fiware.org). We are using currently a shared webhosting, but we need more hardware and grants to run our future system.

We have calculated requirements hardware for the enablers:

RAM: 32Gb (Cosmos) + 4Gb (Ckan) + 8GbRam (SpagoBi) + ¿0.5Gb? (keyrock) + ¿0.5Gb? POI + 1Gb Wirecloud = 32+4+8+0.5+0.5+1Gb=55Gb RAM. HD : 512 GB (Cosmos) + 80Gb (CKAN) + X (SpagoBi) + X (KeyRock) + 40Gb (POI) + 10Gb(Wirecloud)=642+XGb CPU: 3 CPU (Cosmos) + 4CPU (CKAN) + 2CPU (SpagoBI) + 0CPU (KeyRock) + 2CPU (POI) + ¿1CPU? (Wirecloud) = 12CPU

Those numbers are based on the requirements found in documents from the enablers at the bottom. We expect low user quantity interaction with the platform within the next 6 months. Below 300 users.

We need to know which hardware to use, the minimum based on the requirements of the enablers. We have little knowledge in enablers, and can't make a plan without experiences in the field.

Do you think a single machine with 32gb with RAM could, 8 core, 1Tb would fit?

May be it's better to use more machines with lower specs. What do you think?

I'm sure this question is difficult to answer without knowing more information about the project. If I had a contact from someone from fiware to obtain more information, it would be helpful, but I don't know who to contact.

Thanks for your answers in advance

Cosmos

https://github.com/telefonicaid/fiwar...

Cosmos platform requires the following 3 machines:

The master node machine, supporting the APIs and all the management logic of the platform. The Infinity namenode machine, supporting the naming of all the files within the permanent storage of Cosmos. The Infinity datanode machine, supporting the real data of the files managed by the Infinity namenode machine. In addition, at least 2 slave machines are required, in order to host the cluster's nodes. The exact number of slave machines depends on your needs, the many slaves you deploy, the many clusters you will be able to create.

These machines may be physical (recommeded) or virtualized on top on some hipervisor-based virtualization tool such as VirtualBox or VMWare. Anyway, the following hardware is recommended:

32 GB RAM At least 500 GB HDD When formating the file system of the machines (except the one acting as master node), take into account that a specific partition for OpenVZ (/vz) is desirable (format it to ext4).

CKAN

Hardware requirements.

https://github.com/ckan/ckan/wiki/CKA...

For a city level portal with lower traffic levels:

2 * Servers with 2GB of RAM (Web and DB/solr) 80GB hard drive on both. (You may want more storage on the Web server if you intend to do a lot of file storage) Dual core processors

Información adicional

https://blog ... (more)

edit retag flag offensive close merge delete

1 answer

Sort by » oldest newest most voted
0

answered 2016-06-29 11:11:15 +0200

frb gravatar image

There is no need to install Cosmos. Cosmos is the code name of the Hadoop deployment available at FIWARE Lab, which can be used by FIWARE users. It is a shared cluster using the standard Hadoop stack and custom plugins that allow multitenancy. Please have a look on http://catalogue.fiware.org/enablers/...

If you finally don't want to use the shared instance and want to have your own instance, simply install Hadoop (in that case, there is no need for installing any custom plugin from FIWARE).

edit flag offensive delete link more

Comments

Is Cosmos just for development or it can be used for production? If Cosmos it is not for production, which are the minimum hardware requirements to install Hadoop (1 node is enough) + keyrock + POI server + CKAN + Wirecloud + SpagoBI? (Minimum for first customers and tests, little data)

blackbit gravatar imageblackbit ( 2016-06-29 11:29:43 +0200 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2016-06-27 14:47:22 +0200

Seen: 3,971 times

Last updated: Jun 29 '16