aws iot - Kinesis shard with many producers -


i need collect data lots of data sources (e.g., mobile phones). example, 1,000 phones, each uploading batch of 1mb every 20 minutes. thinking use kinesis stream single shard ingest data (the total throughput 1mb/s). make sense individual phones directly access kinesis api, or should put own frontend (e.g., web server) in front? main limits/considerations keep in mind when making decision?

p.s. alternative use aws iot infrastructure considerably more expensive

you should have web service receives data clients , send them kinesis. web server can use kinesis producer library (kpl) offer best performance in terms of message rate delivery, timeout, policy retry , scalability. kpl can create many workers , can tuned optimize message rate , not exceed write limit imposed kinesys shards.

have every single client sends data kinesis overkill in terms of performance, mainenantce costs , delivery. happen if client start sends data @ high rate traffic? shard has rate limit write operation (up 1,000 record/s, data write rate 1 mb/s). 'aggressive' client generate eccessive traffic , make shard not responding while, , block other clients send records should stored in same shard.

moreover, think delivery cost on thousands of clients. happen if want change stream name? or change accessid/ key? or switch kinesis kafka? have manage update of thousands of clients.

with web server, can hide complexity , make change transparent client. can think run web service directly in ec2. have producer directly in aws should reduce network latency. moreover, can take advantage of scalability/resiliency/fault tolerance features offered aws.


-

Comments

Post a Comment

Popular posts from this blog

angular - Is it possible to get native element for formControl? -

i've got angular2 reactive form . created formcontrol s , assigned input fields by [formcontrol]=... . understand creates nativeelement <-> formcontrol link. my question: possible nativeelement formcontrol ? wanna myformcontrol.nativeelement.focus() i can share 1 terrible solution works me. in reactive forms can use either 1) formcontroldirective ts mycontrol = new formcontrol('') template <input type="text" [formcontrol]="mycontrol"> or 2) formcontrolname ts myform: formgroup; constructor(private fb: formbuilder) {} ngoninit() { this.myform = this.fb.group({ foo: '' }); } template <form [formgroup]="myform"> <input type="text" formcontrolname="foo"> </form> so these directives write patch like 1) formcontroldirective const originformcontrolngonchanges = formcontroldirective.prototype.ngonchanges; formcontroldirective.proto
Read more

unity3d - Rotate an object to face an opposite direction -

i have object , b. when click on object b, rotates object b (a faces b). b doesn't face a. need following : when faces b, need face opposite direction. have code rotating @ b. how rotate face opposite direction after that? vector3 targetdirection = target - transform.position; float step = speed * time.deltatime; vector3 newdirection = vector3.rotatetowards (turretdome.transform.forward, targetdirection, step, 0.0f); turretdome.transform.rotation = quaternion.lookrotation (newdirection); you object facing object b, want inverse direction of object after that? objecta.transform.rotation = quaternion.inverse(objecta.transform.rotation) but lets assume example turretdome object a, (negate direction): turretdome.transform.rotation = quaternion.lookrotation (-newdirection); naturally, both of these snippets not show how smoothen rotation, seem know how use time.deltatime. just incase unsure, quaternion.lerp this
Read more

javascript - Why jQuery Select box change event is now working? -

i working on product filters user select select box according his/her preference not getting selected value user in jquery. html code:- <select name="product_filter" id="product_filter"> <option value="price_low_first">price : low high</option> <option value="price_high_first">price : high low</option> <option value="latest">latest</option> <option value="popular">most popular</option> </select> jquery code: $(function () { $("#product_filter").change(function () { alert("hi") var selectedtext = $(this).find("option:selected").text(); var selectedvalue = $(this).val(); alert("selected text: " + selectedtext + " value: " + selectedvalue); }); }); hi believe code perfect. once please check jquery.min.js
Read more