add some draft

Author: hackrole

content/design_data_intensive_application/partition.md

@@ -0,0 +1,48 @@
+# partition or shared
+
+## word concept
+
+### data skew(数据偏斜)/hot_sport(热点)
+
+数据分片不平衡,部分分片数据和负载过大.
+
+高负载分片被称为热点
+
+### consistent hashing(一致性hash)
+
+
+### gossip protocol(流言协议)
+
+
+## shared method
+
+
+1) key-range shared
+
+容易存在热点
+
+2) key-hash shared
+
+range-query in key-hash-shared must send to all shareds
+
+3) consistent-hash shared(hash and range)
+
+## 二级索引
+
+
+## share route
+
+1) Round-Robin Load Balancer: 服务器内部自动路由到正确位置,客户端透明
+
+2) 路由层(mongos)
+
+3) 完全在客户端实现(ruby redis client)
+
+
+## TODO
+
+[a fast, mini-memory consistent hash algorithm](https://arxiv.org/pdf/1406.2294v1.pdf)
+
+[consistent hash random tree](https://www.akamai.com/us/en/multimedia/documents/technical-publication/consistent-hashing-and-random-trees-distributed-caching-protocols-for-relieving-hot-spots-on-the-world-wide-web-technical-publication.pdf)
+
+[service discovery in cloud](http://jasonwilder.com/blog/2014/02/04/service-discovery-in-the-cloud/)

content/design_data_intensive_application/replica.md

@@ -0,0 +1,86 @@
+# replica复制
+
+## word concept
+
+### eventual consistency
+
+最终一致性
+
+### read-your-write
+
+写后读
+
+用户写入主库,读取未同步的从库
+
+
+### monotonic read
+
+单调读
+
+多次读取使用不同的replica, 导致上次读到的内容在下次未同步完成
+
+### 一致前缀读
+
+多个读取来自不同的replica,导致处于后面的数据比前面的数据先出现
+一般分片环境
+
+### 版本向量
+
+## replica algorithm
+
+1) single leader
+
+2) multi leader
+
+3) leaderless
+
+
+## synchronously vs asynchronously
+同步与异步
+
+完全同步replica会导致节点写入延迟高,容易失败.
+
+完全异步写入有可能导致数据丢失,会读取的旧数据等数据不一致问题
+
+
+## add new replica
+
+基于某一时间快照和快照对应的binlog的偏移位置
+
+
+## replica log
+
+1) 基于语句
+
+非确定函数等会导致数据不一致
+
+2) 基于行(逻辑日志)
+
+mysql新版使用这种方式
+
+
+## 多主复制
+
+### 冲突解决
+
+### 拓扑结构
+
+
+## ??
+w + r > n
+
+
+## TODO
+
+[eventually consistent](https://queue.acm.org/detail.cfm?id=1466448)
+
+[mysql-internals-manual](https://dev.mysql.com/doc/internals/en/)
+[mysql-inline](https://www.percona.com/live/mysql-conference-2013)
+
+[clock are bad, welcome to distrubuted system](http://basho.com/posts/technical/clocks-are-bad-or-welcome-to-distributed-systems/)
+
+[eventually consistent detecting](http://messagepassing.blogspot.com/2011/10/eventual-consistency-detecting.html)
+
+[if you must deploy multi-master replication](http://scale-out-blog.blogspot.com/2012/04/if-you-must-deploy-multi-master.html)
+
+[kafka replica](https://www.slideshare.net/junrao/kafka-replication-apachecon2013)

content/distributed_system/note.md

@@ -0,0 +1,27 @@
+# plan
+
+看完design data-intension application和mit 8.624
+
+
+## design data-intension application
+
+[gitbook](https://vonng.gitbooks.io/ddia-cn/content/ch7.html)
+
+## mit 8.624
+
+[mit schedule](https://pdos.csail.mit.edu/6.824/schedule.html)
+
+[mit lecture translation](https://github.com/feixiao/Distributed-Systems)
+
+[mit lecture note](https://github.com/chaozh/MIT-6.824)
+
+[code example](https://github.com/xingdl2007/6.824-2017)
+
+[mit 8.624 note](http://ts25504.github.io/2016/08/16/MIT-6-824%E5%AD%A6%E4%B9%A0%E4%B9%8B%E8%B7%AF/)
+
+[zhihu.com](https://www.zhihu.com/question/29597104)
+
+
+
+[twitter](https://twitter.com/henryr/status/926148187156463616?lang=en)
+[good lecture](https://www.quora.com/Which-is-a-good-online-course-for-studying-distributed-systems-Video-lectures-preferred)

content/django/UltiSnips/md.snippets

@@ -0,0 +1,9 @@
+snippet meta "note meta header for tags,title,summary,date" !b
+Author: hackrole
+Email: [email protected]
+Date: `date +"%Y-%m-%d"`
+Tags: ${1}
+Title: ${2}
+Tummary: ${3}
+$0
+endsnippet

content/django/admin_note.md

@@ -0,0 +1,17 @@
+
+# django admin note
+
+## doc read
+
+### register admin
+
+requirements: auth/message/session/content_type context_processors
+
+```python
+# 
+
+# 
+
+# 
+
+```

content/go-micro/golang_note.md

@@ -0,0 +1,86 @@
+# golang tips
+
+
+## how to write golang
+
+[offical how-to-write-go-code](https://golang.org/doc/code.html)
+
+### all code in workspace, which different from other language
+
+
+### import_path and package_name
+
+1) import_path need to be unique
+
+2) import_path is not package_name
+
+3) for convenience, `import_path == vcs_base_url<github.com/user>/ + package_name``, but this is not neccesary
+
+4) execute_program package name must be main
+
+5) all file in same import path must have same package_name
+
+
+## effective go
+
+[effective go](https://golang.org/doc/effective_go.html#names)
+
+### go examples
+
+### format
+gofmt auto do this.
+
+use indentation instead of space
+
+line length is at you wish.
+
+### comment and doc
+
+package_doc is before `package name`,
+in many file package should only one-file define it.
+it usually define in doc.go.
+
+it should only be text, html is not good idea.
+
+
+func/variable doc is comment immediately preceding a top-level declaration.
+Every exported (capitalized) name in a program should have a doc comment.
+
+### names
+
+1) package name should be good: short, concise, evocative
+
+2) packages are given lower case, single-word names; there should be no need for underscores or mixedCaps.
+
+3) Getter -> <Owner>(Captial). setter -> (SetOwner)(with Set prefix)
+
+4)  one-method interfaces are named by the method name plus an -er(Ex: Reader, Writer, Formatter)
+
+5) Read/Write/String and so on not use in your func name. 
+
+6) use MixCaps instead of underscore for multiword-names.
+
+7) Semicolons is not required.
+
+# control stucture
+
+1) if/for support short declare
+
+2) for is for/while/foreach
+
+3) foreach => for i, v := range items
+
+4) switch and fallthrough
+
+5) type_switch
+```golang
+switch t := t.(type) {
+    case bool: ...
+    case int: ...
+}
+```
+
+
+## the go programming spec
+
+[offical go spec](https://golang.org/ref/spec)

content/go-micro/microservice.md

@@ -0,0 +1,15 @@
+# micro-service concept
+
+
+[martin fowler blog](https://martinfowler.com/articles/microservices.html)
+
+# operations model for microservice
+
+[tekink operations model for microservice](http://callistaenterprise.se/blogg/teknik/2015/03/25/an-operations-model-for-microservices/)
+
+
+# circuitBreaker 断路器
+
+[martin circuit breaker](https://martinfowler.com/bliki/CircuitBreaker.html)
+
+[netflix hystrix circuit-breaker](https://github.com/Netflix/Hystrix/)

content/plan.md

@@ -0,0 +1,44 @@
+# microservice
+## go-micro framework
+## martni flow blog
+## grpc
+## hashiple tools
+
+# distribution system
+
+## desgin data-intension application
+
+## mit 6.824
+
+# python
+
+## alogrithm
+  
+[algorithm](https://github.com/keon/algorithms)
+[algorithm](https://github.com/grantjenks/python-sortedcontainers)
+
+[python patterns](https://github.com/faif/python-patterns)
+[python patterns](https://github.com/tylerlaberge/PyPattyrn)
+
+## source-code
+
+requests
+
+flask
+
+hub
+
+tornado
+
+django
+
+## numpy/matplatlib/keras/sklearn/dask
+
+# Golang
+
+## go book
+
+## go stdlib
+
+## go-micro
+

content/plan.org

@@ -0,0 +1,11 @@
+* microservice
+** TODO go-micro framework
+** TODO martni flow blog
+** TODO grpc
+** TODO hashiple tools
+
+* TODO distribution system
+
+** TODO desgin data-intension application
+
+** TODO mit 6.824

content/python/editor_tools.py

@@ -0,0 +1,9 @@
+# editor tools
+
+## isort
+
+## yapf
+
+## emacs lpy
+
+## emacs ob-python