Skip to content

k3etcd

Action-CI Documentation Status Package

Python client for etcd server version 2.3.x and later.

k3etcd is a component of pykit3 project: a python3 toolkit set.

Installation

pip install k3etcd

API Reference

k3etcd

Python client for etcd server version 2.3.x and later.

See: https://github.com/coreos/etcd

Client

Bases: object

Source code in k3etcd/client.py
 482
 483
 484
 485
 486
 487
 488
 489
 490
 491
 492
 493
 494
 495
 496
 497
 498
 499
 500
 501
 502
 503
 504
 505
 506
 507
 508
 509
 510
 511
 512
 513
 514
 515
 516
 517
 518
 519
 520
 521
 522
 523
 524
 525
 526
 527
 528
 529
 530
 531
 532
 533
 534
 535
 536
 537
 538
 539
 540
 541
 542
 543
 544
 545
 546
 547
 548
 549
 550
 551
 552
 553
 554
 555
 556
 557
 558
 559
 560
 561
 562
 563
 564
 565
 566
 567
 568
 569
 570
 571
 572
 573
 574
 575
 576
 577
 578
 579
 580
 581
 582
 583
 584
 585
 586
 587
 588
 589
 590
 591
 592
 593
 594
 595
 596
 597
 598
 599
 600
 601
 602
 603
 604
 605
 606
 607
 608
 609
 610
 611
 612
 613
 614
 615
 616
 617
 618
 619
 620
 621
 622
 623
 624
 625
 626
 627
 628
 629
 630
 631
 632
 633
 634
 635
 636
 637
 638
 639
 640
 641
 642
 643
 644
 645
 646
 647
 648
 649
 650
 651
 652
 653
 654
 655
 656
 657
 658
 659
 660
 661
 662
 663
 664
 665
 666
 667
 668
 669
 670
 671
 672
 673
 674
 675
 676
 677
 678
 679
 680
 681
 682
 683
 684
 685
 686
 687
 688
 689
 690
 691
 692
 693
 694
 695
 696
 697
 698
 699
 700
 701
 702
 703
 704
 705
 706
 707
 708
 709
 710
 711
 712
 713
 714
 715
 716
 717
 718
 719
 720
 721
 722
 723
 724
 725
 726
 727
 728
 729
 730
 731
 732
 733
 734
 735
 736
 737
 738
 739
 740
 741
 742
 743
 744
 745
 746
 747
 748
 749
 750
 751
 752
 753
 754
 755
 756
 757
 758
 759
 760
 761
 762
 763
 764
 765
 766
 767
 768
 769
 770
 771
 772
 773
 774
 775
 776
 777
 778
 779
 780
 781
 782
 783
 784
 785
 786
 787
 788
 789
 790
 791
 792
 793
 794
 795
 796
 797
 798
 799
 800
 801
 802
 803
 804
 805
 806
 807
 808
 809
 810
 811
 812
 813
 814
 815
 816
 817
 818
 819
 820
 821
 822
 823
 824
 825
 826
 827
 828
 829
 830
 831
 832
 833
 834
 835
 836
 837
 838
 839
 840
 841
 842
 843
 844
 845
 846
 847
 848
 849
 850
 851
 852
 853
 854
 855
 856
 857
 858
 859
 860
 861
 862
 863
 864
 865
 866
 867
 868
 869
 870
 871
 872
 873
 874
 875
 876
 877
 878
 879
 880
 881
 882
 883
 884
 885
 886
 887
 888
 889
 890
 891
 892
 893
 894
 895
 896
 897
 898
 899
 900
 901
 902
 903
 904
 905
 906
 907
 908
 909
 910
 911
 912
 913
 914
 915
 916
 917
 918
 919
 920
 921
 922
 923
 924
 925
 926
 927
 928
 929
 930
 931
 932
 933
 934
 935
 936
 937
 938
 939
 940
 941
 942
 943
 944
 945
 946
 947
 948
 949
 950
 951
 952
 953
 954
 955
 956
 957
 958
 959
 960
 961
 962
 963
 964
 965
 966
 967
 968
 969
 970
 971
 972
 973
 974
 975
 976
 977
 978
 979
 980
 981
 982
 983
 984
 985
 986
 987
 988
 989
 990
 991
 992
 993
 994
 995
 996
 997
 998
 999
1000
1001
1002
1003
1004
1005
1006
1007
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
1039
1040
1041
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
1089
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
1100
1101
1102
1103
1104
1105
1106
1107
1108
1109
1110
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
1132
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
1162
1163
1164
1165
1166
1167
1168
1169
1170
1171
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
1200
1201
1202
1203
1204
1205
1206
1207
1208
1209
1210
1211
1212
1213
1214
1215
1216
1217
1218
1219
1220
1221
1222
1223
1224
1225
1226
1227
1228
1229
1230
1231
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
1254
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
1265
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
1277
1278
1279
1280
1281
1282
1283
1284
1285
1286
1287
1288
1289
1290
1291
1292
1293
1294
1295
1296
1297
1298
1299
1300
1301
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
1312
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
1333
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
1346
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
1366
1367
1368
1369
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
1381
1382
1383
1384
1385
1386
1387
1388
1389
1390
1391
1392
1393
1394
1395
1396
1397
1398
1399
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
1419
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
1438
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
1474
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490
1491
1492
1493
1494
1495
1496
1497
1498
1499
1500
1501
1502
1503
1504
1505
1506
1507
1508
1509
1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
1523
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
1539
1540
1541
1542
1543
1544
1545
1546
1547
1548
1549
1550
1551
1552
1553
1554
1555
1556
1557
1558
1559
1560
1561
1562
1563
1564
1565
1566
1567
1568
1569
1570
1571
1572
1573
1574
1575
1576
class Client(object):
    _MGET = "GET"
    _MPUT = "PUT"
    _MPOST = "POST"
    _MDELETE = "DELETE"

    _write_conditions = {"prevValue", "prevIndex", "prevExist"}
    _read_options = {"recursive", "wait", "waitIndex", "sorted", "quorum"}
    _del_conditions = {"prevValue", "prevIndex"}
    """
    ##  etcd.Client.base_uri

    Type is `str`, the default etcd server clienturl.

    ##  etcd.Client.host

    Type is `str`, the default etcd server ip.
    Defaults to `127.0.0.1`.

    ##  etcd.Client.port

    Type is `int`, the port used to connect to etcd server.
    Defaults to `2379`.

    ##  etcd.Client.protocol

    Type is `str`, protocol used to connect etcd server.
    Only support http, defaults to `http`.

    ##  etcd.Client.read_timeout

    Max seconds to wait for a request.
    Type is `int`, defaults to `10`.

    ##  etcd.Client.allow_redirect

    Type is `bool`, allow the client to connect other nodes.
    Defaults to `True`.

    ##  etcd.Client.machines

    Members of the cluster.
    Type is `list`, like `['http://127.0.0.1:4001', 'http://127.0.0.1:4002']`.

    ##  etcd.Client.members

    A more structured view of peers in the cluster.
    Type is `list`, like

    ```python
    [
        {
          "id": "291578612bc6deb",
          "name": "node_0",
          "peerURLs": [
            "http://192.168.52.30:3380"
          ],
          "clientURLs": [
            "http://192.168.52.30:3379"
          ]
        },
        {
          "id": "183ebbe2e22ee250",
          "name": "node_2",
          "peerURLs": [
            "http://192.168.52.32:3380"
          ],
          "clientURLs": [
            "http://192.168.52.32:3379"
          ]
        },
    ]
    ```

    ##  etcd.Client.leader

    **syntax**:
    `etcd.Client.leader`

    The leader of the cluster.
    Type is `dict`, like
    ```python
    {
        "id":"ce2a822cea30bfca",
        "name":"n",
        "peerURLs":["http://127.0.0.1:2380"],
        "clientURLs":["http://127.0.0.1:4001"]
    }
    ```

    ##  etcd.Client.version

    Version of etcd server.

    ##  etcd.Client.st_leader

    The stats of the leader.
    Type is `dict`.

    ##  etcd.Client.st_self

    The stats of the local server.
    Type is `dict`.

    ##  etcd.Client.st_store

    The stats of the kv store.
    Type is `dict`.

    ##  etcd.Client.names

    Name of members in the cluster.
    Type is `list`.

    ##  etcd.Client.ids

    Id of members in the cluster.
    Type is `list`.

    ##  etcd.Client.clienturls

    ClientUrls of members in the cluster.
    Type is `list`.

    ##  etcd.Client.peerurls

    PeerUrls of members in the cluster.
    Type is `list`.
    """

    def __init__(
        self,
        host="127.0.0.1",
        port=2379,
        version_prefix="/v2",
        read_timeout=10,
        allow_redirect=True,
        protocol="http",
        allow_reconnect=True,
        basic_auth_account=None,
    ):
        """
        Etcd client class.
        :param host: Mixed, if a `str`, it is the IP to connect to.
        If a `tuple` or `list`, like `((ip, port), (ip, port))`.
        Defaults to `127.0.0.1`.
        :param port: Type is `int`, the port used to connect to etcd server.
        Defaults to `2379`.
        :param version_prefix: Type is `str`, url or version prefix in etcd url. Defaults to `v2`.
        :param read_timeout: Type is `int`, max seconds to wait for a request. Defaults to `10`.
        :param allow_redirect: Type is `bool`, allow the client to connect other nodes. Defaults to `True`.
        :param protocol: Type is `str`, right now only support http. Defaults to `http`.
        :param allow_reconnect: Type is `bool`, allow the client to reconnect to another etcd server
        in the cluster in the case the default one does not respond. Defaults to `True`.
        :param basic_auth_account: Type is `str`, the authorization information. Defaults to `None`.
        """
        self._protocol = protocol
        if protocol == "https":
            raise EtcdSSLError("not supported https right now")

        self._machines_cache = []
        if not list_type(host):
            self._host = host
            self._port = int(port)
            self._base_uri = "%s://%s:%d" % (self._protocol, self._host, self._port)
        else:
            for h in host:
                if list_type(h):
                    _h, _p = (list(h) + [int(port)])[:2]
                else:
                    _h, _p = h, int(port)
                self._machines_cache.append("%s://%s:%d" % (self._protocol, _h, _p))

            self._base_uri = self._machines_cache.pop(0)
            _, self._host, self._port = self._extract_base_uri()

        self.version_prefix = version_prefix
        self._keys_path = self.version_prefix + "/keys"
        self._stats_path = self.version_prefix + "/stats"
        self._mem_path = self.version_prefix + "/members"
        self._user_path = self.version_prefix + "/auth/users"
        self._role_path = self.version_prefix + "/auth/roles"
        self._read_timeout = read_timeout
        self._allow_redirect = allow_redirect
        self._allow_reconnect = allow_reconnect
        self.basic_auth_account = basic_auth_account

        if self._allow_reconnect:
            if len(self._machines_cache) <= 0:
                self._machines_cache = self.machines
            if self._base_uri in self._machines_cache:
                self._machines_cache.remove(self._base_uri)
        else:
            self._machines_cache = []

    @property
    def base_uri(self):
        return self._base_uri

    @property
    def host(self):
        return self._host

    @property
    def port(self):
        return self._port

    @property
    def protocol(self):
        return self._protocol

    @property
    def read_timeout(self):
        return self._read_timeout

    @property
    def allow_redirect(self):
        return self._allow_redirect

    @property
    def machines(self):
        res = self.api_execute(self.version_prefix + "/machines", self._MGET, need_refresh_machines=False)

        nodes = res.data.split(",")

        return [n.strip() for n in nodes]

    @property
    def members(self):
        res = self.api_execute(self._mem_path, self._MGET)

        return k3utfjson.load(res.data)["members"]

    @property
    def leader(self):
        res = self.api_execute(self._stats_path + "/self", self._MGET)
        self_st = k3utfjson.load(res.data)

        leader_id = self_st.get("leaderInfo", {}).get("leader")
        if leader_id is None:
            return None

        mems = self.members
        for mem in mems:
            if mem["id"] != leader_id:
                continue

            return mem.copy()

    @property
    def version(self):
        res = self.api_execute("/version", self._MGET)

        return k3utfjson.load(res.data)

    @property
    def st_leader(self):
        leader = self.leader
        if leader is None:
            return None

        leaderhosts = []
        for url in leader["clientURLs"]:
            if not url.startswith(self._protocol):
                url = self._protocol + "://" + url
            p = urllib.parse.urlparse(url)
            if p.hostname == "127.0.0.1":
                continue

            port = p.port or self.port
            leaderhosts.append((p.hostname, port))

        return Client(host=leaderhosts)._st("/leader")

    @property
    def st_self(self):
        return self._st("/self")

    @property
    def st_store(self):
        return self._st("/store")

    @property
    def names(self):
        return [n["name"] for n in self.members]

    @property
    def ids(self):
        return [n["id"] for n in self.members]

    @property
    def clienturls(self):
        return sum([n["clientURLs"] for n in self.members], [])

    @property
    def peerurls(self):
        return sum([n["peerURLs"] for n in self.members], [])

    def __contains__(self, key):
        try:
            self.get(key)
            return True
        except EcodeKeyNotFound:
            return False

    def _sanitize_key(self, key):
        if not key.startswith("/"):
            key = "/{key}".format(key=key)
        return key

    def _extract_base_uri(self):
        p = urllib.parse.urlparse(self._base_uri)
        return p.scheme, p.hostname, p.port

    def _parse_url(self, url):
        p = urllib.parse.urlparse(url)

        if p.scheme == "https":
            raise EtcdSSLError("not supported https right now. " + url)
        elif p.scheme != "http":
            return None, None, url

        port = p.port or self.port

        return p.hostname, port, p.path

    def _generate_params(self, options, argkv):
        params = {}
        for k, v in list(argkv.items()):
            if k not in options:
                continue

            if isinstance(v, bool):
                params[k] = v and "true" or "false"
                continue

            params[k] = v

        return params

    def _st(self, st_path):
        st_path = self._sanitize_key(st_path)
        response = self.api_execute(self._stats_path + st_path, self._MGET)
        return self._to_dict(response)

    def _to_keysresult(self, response):
        try:
            res = k3utfjson.load(response.data)
            r = EtcdKeysResult(**res)
            r.parse_response(response)
            return r
        except ValueError as e:
            logger.error(repr(e) + " while decode {data}".format(data=response.data))
            raise EtcdIncompleteRead("failed to decode %s" % response.data)
        except Exception as e:
            logger.error(repr(e) + " while decode {data}".format(data=response.data))
            raise EtcdResponseError("failed to decode %s" % response.data)

    def _to_dict(self, response):
        try:
            return k3utfjson.load(response.data)
        except ValueError as e:
            logger.error(repr(e) + " while decode {data}".format(data=response.data))
            raise EtcdIncompleteRead("failed to decode %s" % response.data)
        except Exception as e:
            logger.error(repr(e) + " while decode {data}".format(data=response.data))
            raise EtcdResponseError("failed to decode %s" % response.data)

    def _handle_server_response(self, response):
        if response.status in (http.client.OK, http.client.CREATED, http.client.NO_CONTENT):
            return response

        logger.debug("invalid response status:{st} body:{body}".format(st=response.status, body=response.data))

        EtcdError.handle(response)

    def _request(self, url, method, params, timeout, bodyinjson):
        while True:
            host, port, path = self._parse_url(url)
            if host is None or port is None or path is None:
                raise EtcdException("url is invalid, {url}".format(url=url))

            qs = {}
            headers = {}
            body = ""

            if method in (self._MGET, self._MDELETE):
                qs.update(params or {})

                # use once, coz params is in location's query string
                params = None
                headers["Content-Length"] = 0

            elif method in (self._MPUT, self._MPOST):
                if bodyinjson:
                    if params is not None:
                        body = k3utfjson.dump(params)
                    headers.update({"Content-Type": "application/json", "Content-Length": len(body)})
                else:
                    body = urllib.parse.urlencode(params or {})
                    headers.update({"Content-Type": "application/x-www-form-urlencoded", "Content-Length": len(body)})
            else:
                raise EtcdRequestError("HTTP method {method} not supported".format(method=method))

            if len(qs) > 0:
                if "?" in path:
                    path = path + "&" + urllib.parse.urlencode(qs)
                else:
                    path = path + "?" + urllib.parse.urlencode(qs)

            if self.basic_auth_account is not None:
                auth = {
                    "Authorization": "Basic {ant}".format(
                        ant=base64.b64encode(self.basic_auth_account.encode()).strip().decode()
                    ),
                }
                headers.update(auth)

            logger.debug(
                "connect -> {mtd} {url}{path} {timeout}".format(
                    mtd=method, url=self._base_uri, path=path, timeout=timeout
                )
            )

            h = k3http.Client(host, port, timeout)
            h.send_request(path, method, headers)
            h.send_body(body)
            h.read_response()

            resp = Response.from_http(h)

            if not self.allow_redirect:
                return resp

            if resp.status not in Response.REDIRECT_STATUSES:
                return resp

            url = resp.get_redirect_location()
            if url is None:
                raise EtcdResponseError("location not found in {header}".format(header=resp.headers))

            logger.debug("redirect -> " + url)

    def _api_execute_with_retry(
        self, path, method, params=None, timeout=None, bodyinjson=False, raise_read_timeout=False, **request_kw
    ):
        # including _base_uri, there are len(_machines_cache) + 1 hosts to try
        # to connect to.
        for i in range(len(self._machines_cache) + 1):
            url = self._base_uri + path

            try:
                response = self._request(url, method, params, timeout, bodyinjson)
                break
            except (socket.error, k3http.HttpError) as e:
                if raise_read_timeout and isinstance(e, socket.timeout):
                    raise EtcdReadTimeoutError(e)

                if len(self._machines_cache) > 0:
                    self._machines_cache.append(self._base_uri)
                    self._base_uri = self._machines_cache.pop(0)
                    self._protocol, self._host, self._port = self._extract_base_uri()

                    logger.info(
                        "{err} while connect {cur}, try connect {nxt}".format(err=repr(e), cur=url, nxt=self._base_uri)
                    )

                else:
                    logger.info("no more host to retry")

            except Exception as e:
                logger.exception(repr(e) + " while send request to etcd")
                raise EtcdException(e)

        else:
            raise NoMoreMachineError("No more machines in the cluster")

        return self._handle_server_response(response)

    def api_execute(
        self,
        path,
        method,
        params=None,
        timeout=None,
        bodyinjson=False,
        raise_read_timeout=False,
        need_refresh_machines=True,
        **request_kw,
    ):
        if timeout is None:
            timeout = self.read_timeout
        if timeout == 0:
            timeout = None

        if not path.startswith("/"):
            raise ValueError("Path does not start with /")

        for i in range(0, 2):
            try:
                return self._api_execute_with_retry(
                    path,
                    method,
                    params=params,
                    timeout=timeout,
                    bodyinjson=bodyinjson,
                    raise_read_timeout=raise_read_timeout,
                    **request_kw,
                )

            except NoMoreMachineError as e:
                logger.info(repr(e) + " while send_request path:{path}, method:{mtd}".format(path=path, mtd=method))

                if i == 1 or not need_refresh_machines or not self._allow_reconnect:
                    raise

                new_machines = self.machines
                old_machines = self._machines_cache + [self._base_uri]

                if set(new_machines) == set(old_machines):
                    raise

                self._machines_cache = new_machines
                self._base_uri = self._machines_cache.pop(0)
                self._protocol, self._host, self._port = self._extract_base_uri()

    def read(self, key, **argkv):
        """
        Get the value with `key`
        :param key: The key which wil be accessed. `/XXX` is same as `XXX`.
        :param argkv: Other kv args.

        `recursive(bool)`:
        Fetch a dir recursively.

        `wait(bool)`:
        Wait and return next time the key is changed.

        `waitIndex(int)`:
        The index to fetch results from.

        `sorted(bool)`:
        Sort the output keys.

        `quorum(bool)`:
        If `True`, get value through raft.

        `timeout(int)`:
        Max seconds to wait for the request.
        :return: A `etcd.EtcdKeysResult` object.
        """
        key = self._sanitize_key(key)
        params = self._generate_params(self._read_options, argkv)
        timeout = argkv.get("timeout")
        response = self.api_execute(self._keys_path + key, self._MGET, params=params, timeout=timeout)

        return self._to_keysresult(response)

    get = read

    def write(self, key, value=None, ttl=None, dir=False, append=False, refresh=False, **argkv):
        """
        Writes the value for a key, possibly doing atomic Compare-and-Swap.
        Raise a `etcd.EtcdRequestError` when `value is not None` and `dir is True`.
        :param key: The key that will be writen.
        `/XXX` is same as `XXX`.
        :param value: Value to set. Defaults to `None`.
        :param ttl: Time in seconds of expiration (optional).
        Type is `int`. Defaults to `None`.
        :param dir: Set to `True` if we are writing a directory.
        Type is `bool`. Defaults to `False`.
        :param append: If `True`, it will post to append the new value to the dir, creating a sequential key.
        Defaults to false.
        :param refresh: If `True`, only update the ttl, prev key must existed(`prevExist=True`).
        :param argkv: Other kv args.
        `prevValue`: Compare with this value, and swap only if corresponding (optional).
        `prevIndex(int)`: Modify key only if actual modifiedIndex matches the provided one (optional).
        `prevExist(bool)`: If `False`, only create key; if `True`, only update key.
        :return: A `etcd.EtcdKeysResult` object.
        """
        key = self._sanitize_key(key)

        params = {}
        if ttl is not None:
            params["ttl"] = ttl

        if dir and value is not None:
            raise EtcdRequestError("Cannot create a directory with a value " + repr(value))
        elif value is not None:
            params["value"] = value
        elif dir:
            params["dir"] = "true"

        if refresh:
            params["refresh"] = "true"

        params.update(self._generate_params(self._write_conditions, argkv))

        method = append and self._MPOST or self._MPUT
        if "_endpoint" in argkv:
            path = argkv["_endpoint"] + key
        else:
            path = self._keys_path + key

        response = self.api_execute(path, method, params=params)

        return self._to_keysresult(response)

    def test_and_set(self, key, value, ttl=None, **argkv):
        """
        Set `value` with `key`.
        :param key: See `key` in `etcd.Client.write`.
        :param value: See `value` in `etcd.Client.write`.
        :param ttl: See `ttl` in `etcd.Client.write`.
        :param argkv: See other kv args in `etcd.Client.write`.
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.write(key, value=value, ttl=ttl, **argkv)

    def set(self, key, value, ttl=None):
        """
        Set `value` with `key`.
        :param key: See `key` in `etcd.Client.write`.
        :param value: See `value` in `etcd.Client.write`.
        :param ttl: See `ttl` in `etcd.Client.write`.
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.write(key, value=value, ttl=ttl)

    def update(self, res):
        """
        Updates the value for a key atomically.
        :param res: A `etcd.EtcdKeysResult` object.
        :return: A `etcd.EtcdKeysResult` object.
        """
        # c = etcd.Client(host=hosts)
        # res = c.read("/somekey")
        # res.value += 1
        # c.update(res)
        argkv = {
            "dir": res.dir,
            "ttl": res.ttl,
            "prevExist": True,
        }

        if not res.dir:
            # prevIndex on a dir causes a 'not a file' error. d'oh!
            argkv["prevIndex"] = res.modifiedIndex

        return self.write(res.key, value=res.value, **argkv)

    def delete(self, key, recursive=None, dir=None, **argkv):
        """
        Remove a key from etcd.
        :param key: The key which will be delete.
        :param recursive: If we want to recursively delete a directory, set it to `True`.
        Defaults to `None`.
        :param dir: If we want to delete a directory, set it to `True`.
        Defaults to `None`.
        :param argkv: Other kv args.
        `prevValue`:
        Compare with this value and delete only if corresponding (optional).
        `prevIndex(int)`:
        Delete only if actual modifiedIndex matches the provided one (optional).
        :return: A `etcd.EtcdKeysResult` object.
        """
        key = self._sanitize_key(key)

        params = {}
        if recursive is not None:
            params["recursive"] = recursive and "true" or "false"

        if dir is not None:
            params["dir"] = dir and "true" or "false"

        params.update(self._generate_params(self._del_conditions, argkv))

        response = self.api_execute(self._keys_path + key, self._MDELETE, params=params)

        return self._to_keysresult(response)

    def test_and_delete(self, key, **argkv):
        """
        Remove a key from etcd.
        :param key: The key which will be delete.
        :param argkv: See other kv args in `etcd.Client.delete`.
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.delete(key, **argkv)

    def watch(self, key, waitindex=None, timeout=None, **argkv):
        """
        Blocks until a new event has been received or timeout.
        Raise a `etcd.EtcdReadTimeoutError` if timeout.
        :param key: The key which will be watched.
        :param waitindex:     Index to start from.
        Type is `int`. Defautls to `None`.
        If `None` use the newest index.
        :param timeout: Max seconds to wait.
        If `None`, use `etcd.Client.read_timeout`.
        If `0` means infinite waiting.
        :param argkv: Other kv args.
        `recursive(bool)`
        If want to watch a dir, set `True`.
        `waitIndex(int)`:
        If `waitindex` is `None`, use it.
        :return: A `etcd.EtcdKeysResult` object.
        """
        newest_v = self.get(key)

        if waitindex is None:
            waitindex = argkv.get("waitIndex")

        if waitindex is not None and 0 < waitindex <= newest_v.modifiedIndex:
            return newest_v
        else:
            waitindex = newest_v.etcd_index + 1
            return self._watch(key, waitindex, timeout, **argkv)

    def _watch(self, key, waitindex=None, timeout=None, **argkv):
        key = self._sanitize_key(key)

        params = self._generate_params(self._read_options, argkv)
        params["wait"] = "true"

        if waitindex is not None:
            params["waitIndex"] = waitindex

        # timeout is 0 means infinite waiting
        while True and timeout == 0:
            try:
                response = self.api_execute(self._keys_path + key, self._MGET, params=params, timeout=timeout)
                return self._to_keysresult(response)
            except EtcdIncompleteRead:
                pass

        timeout = timeout or self.read_timeout

        while True:
            st = time.time()
            try:
                response = self.api_execute(
                    self._keys_path + key, self._MGET, params=params, timeout=timeout, raise_read_timeout=True
                )
                return self._to_keysresult(response)
            except (EtcdIncompleteRead, EtcdReadTimeoutError):
                timeout = timeout - (time.time() - st)
                if timeout <= 0:
                    raise EtcdReadTimeoutError("Watch Timeout: " + key)

    def eternal_watch(self, key, waitindex=None, until=None, **argkv):
        """
        Blocks until the modify index of the key is ge than `until`.
        :param key: See `key` in `etcd.Client.watch`.
        :param waitindex: See `waitindex` in `etcd.Client.watch`.
        :param until: Break the loop when the modify index of the key is ge than it.
        If `None`, the loop will not be break. Defaults to `None`
        :param argkv: See other kv args in `etcd.Client.watch`.
        :return: It is an iterator. Each element is a `etcd.EtcdKeysResult` object.
        """
        local_index = waitindex
        while True:
            res = self._watch(key, waitindex=local_index, timeout=0, **argkv)
            if until is not None and res.modifiedIndex is not None:
                if res.modifiedIndex >= until:
                    yield res
                    return

            if local_index is not None:
                local_index = (res.modifiedIndex or local_index) + 1

            yield res

    def mkdir(self, key, ttl=None, **argkv):
        """
        Create a dir in the cluster.
        :param key: The key that will be created.
        :param ttl: Time in seconds of expiration.
        See `ttl` in `etcd.Client.write`.
        :param argkv:
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.write(key, ttl=ttl, dir=True, **argkv)

    def refresh(self, key, ttl=None, **argkv):
        """
        Update the `ttl` of the `key`.
        :param key: See `key` in `etcd.Client.write`.
        :param ttl: Time in seconds of expiration.
        See `ttl` in `etcd.Client.write`.
        :param argkv:
        :return: A `etcd.EtcdKeysResult` object.
        """
        argkv["prevExist"] = True
        return self.write(key, ttl=ttl, refresh=True, **argkv)

    def lsdir(self, key, **argkv):
        """
        Get all nodes of the dir with `key`.
        :param key: The key that will be got.
        See `key` in `etcd.Client.read`.
        :param argkv:
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.read(key, **argkv)

    def rlsdir(self, key, **argkv):
        argkv["recursive"] = True
        return self.read(key, **argkv)

    def deldir(self, key, **argkv):
        """
        Delete a dir in cluster with `key`.
        :param key: The key that will be deleted.
        See `key` in `etcd.Client.delete`.
        :param argkv:
        :return: A `etcd.EtcdKeysResult` object.
        """
        return self.delete(key, dir=True, **argkv)

    def rdeldir(self, key, **argkv):
        """
        Delete a dir in cluster with `key` recursively.
        :param key: The key that will be deleted.
        See `key` in `etcd.Client.delete`.
        :param argkv:
        :return: A `etcd.EtcdKeysResult` object.
        """
        argkv["recursive"] = True
        return self.delete(key, dir=True, **argkv)

    def add_member(self, *peerurls):
        """
        Add a new node in the cluster.

        Raise a `etcd.EtcdResponseError` if the cluster fails to process the request.

        Raise a `etcd.EtcdException` if the member exists in the cluster
        or existed in the cluster at some point in the past
        or any of the given peerURLs exists in the cluster.
        :param peerurls: The new node peerurls.
        Type is `list`, like`['http://127.0.0.1:2380',]`
        :return: A `dick`
        """
        if len(peerurls) == 0:
            raise EtcdException("no peer url found")

        data = {"peerURLs": peerurls}
        response = self.api_execute(self._mem_path, self._MPOST, params=data, bodyinjson=True)

        return self._to_dict(response)

    def del_member(self, mid):
        """
        Remove a member from the cluster.
        :param mid: The id of the node in the cluster.
        :return: nothing
        """
        if mid not in self.ids:
            logger.info("{mid} not in the cluster when delete member".format(mid=mid))
            return

        mid = self._sanitize_key(mid)
        self.api_execute(self._mem_path + mid, self._MDELETE)

    def change_peerurls(self, mid, *peerurls):
        """
        Change the peer urls of a given member.
        :param mid: The id of the node in the cluster.
        :param peerurls: The peerurls that will be set to the member.
        Type is `list`, like`['http://127.0.0.1:2380',]`
        :return: nothing
        """
        if mid not in self.ids:
            logger.info("{mid} not in the cluster when change peerurls".format(mid=mid))
            return

        if len(peerurls) == 0:
            raise EtcdException("no peer url found")

        mid = self._sanitize_key(mid)
        data = {"peerURLs": peerurls}

        self.api_execute(self._mem_path + mid, self._MPUT, params=data, bodyinjson=True)

    def _root_auth(self, password):
        return "root:%s" % (password)

    def create_root(self, password):
        """
        Create root user in the cluster.
        :param password: The password of the root user.
        :return: A `dict`, like`{"user":"root","roles":["root"]}`
        """
        path = self._user_path + "/root"
        params = {"user": "root", "password": password}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def enable_auth(self, root_password):
        """
        Enable authorization.
        :param root_password: The password of the root user.
        :return: nothing
        """
        self.basic_auth_account = self._root_auth(root_password)
        self.api_execute("/v2/auth/enable", self._MPUT)

    def disable_auth(self, root_password):
        """
        Disable authorization.
        :param root_password: The password of the root user.
        :return: nothing
        """
        self.basic_auth_account = self._root_auth(root_password)
        self.api_execute("/v2/auth/enable", self._MDELETE)

    def create_user(self, name, password, root_password, roles=None):
        """
        Create a user in the cluster.
        :param name: The name of the user.
        :param password: The password of user.
        :param root_password: The password of the root user.
        :param roles: The roles that will be granted to the user.
        A `list`, like`['r1', 'r2']`. Defaults to `None`.
        :return: A `dict`, like`{"user":"u1","roles":['r1']}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._user_path + self._sanitize_key(name)
        if roles is not None:
            params = {"user": name, "password": password, "roles": roles}
        else:
            params = {"user": name, "password": password}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def create_role(self, name, root_password, permissions=None):
        """
        Create a role in the cluster.
        :param name: The name of the role.
        :param root_password: The password of the root user.
        :param permissions: A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
        Defaults to `None`.
        :return: A `dict`, like`{"role":"w_role","permissions":{"kv":{"read":["/*"],"write":["/*"]}}}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._role_path + self._sanitize_key(name)
        if permissions is not None:
            params = {"role": name, "permissions": {"kv": permissions}}
        else:
            params = {"role": name}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def get_user(self, name, root_password):
        """
        Get the user information of the cluster.
        :param name: The name of the user.
        if `None`, return all users information.

        :param root_password: The password of the root user.
        :return: A `dict`
        """
        # {
        #     "user": "root",
        #     "roles": [
        #         {
        #             "role": "root",
        #             "permissions": {
        #                 "kv": {
        #                     "read": [
        #                         "/*"
        #                     ],
        #                     "write": [
        #                         "/*"
        #                     ]
        #                 }
        #             }
        #         }
        #     ]
        # }
        self.basic_auth_account = self._root_auth(root_password)
        if name is not None:
            path = self._user_path + self._sanitize_key(name)
        else:
            path = self._user_path

        res = self.api_execute(path, self._MGET)
        return self._to_dict(res)

    def get_role(self, name, root_password):
        """
        Get the role information of the cluster.
        :param name: The name of the role.
        if `None`, return all roles information.
        :param root_password: The password of the root user.
        :return: a dict
        """
        self.basic_auth_account = self._root_auth(root_password)
        if name is not None:
            path = self._role_path + self._sanitize_key(name)
        else:
            path = self._role_path

        res = self.api_execute(path, self._MGET)
        return self._to_dict(res)

    def grant_user_roles(self, name, root_password, roles):
        """
        Grant roles to user.
        :param name: The name of the user.
        :param root_password: The password of the root user.
        :param roles: The roles that will be granted to the user.
        A `list`, like`['r1', 'r2']`.
        :return: A `dict`, like`{u'user': u'u_test', u'roles': [u'r_test']}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._user_path + self._sanitize_key(name)
        params = {"user": name, "grant": roles}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def revoke_user_roles(self, name, root_password, roles):
        """
        Grant roles to user.
        :param name: The name of the user.
        :param root_password: The password of the root user.
        :param roles: The roles that will be revoked from the user.
        A `list`, like`['r1', 'r2']`.
        :return: A `dict`, like`{u'user': u'u_test', u'roles': []}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._user_path + self._sanitize_key(name)
        params = {"user": name, "revoke": roles}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def grant_role_permissions(self, name, root_password, permissions):
        """
        Grant permissions to the role.
        :param name: The name of the role.
        :param root_password: The password of the root user.
        :param permissions: The permissions that will be granted to the role.
        A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
        :return: A `dict`, like`{u'role': u'r_test', u'permissions': {u'kv': {u'read': [u'/*'], u'write': []}}}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._role_path + self._sanitize_key(name)
        params = {"role": name, "grant": {"kv": permissions}}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def revoke_role_permissions(self, name, root_password, permissions):
        """
        Revoke permissions from the role.
        :param name: The name of the role.
        :param root_password: The password of the root user.
        :param permissions: The permissions that will be granted to the role.
        A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
        :return: A `dict`, like`{u'role': u'r_test', u'permissions': {u'kv': {u'read': [], u'write': []}}}`
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._role_path + self._sanitize_key(name)
        params = {"role": name, "revoke": {"kv": permissions}}

        res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
        return self._to_dict(res)

    def delete_user(self, user_name, root_password):
        """
        Delete the user of the cluster.
        :param user_name: The name of the user.
        :param root_password: The password of the root user.
        :return: nothing
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._user_path + self._sanitize_key(user_name)
        self.api_execute(path, self._MDELETE)

    def delete_role(self, role_name, root_password):
        """
        Delete the role of the cluster.
        :param role_name: The name of the role.
        :param root_password: The password of the root user.
        :return: nothing
        """
        self.basic_auth_account = self._root_auth(root_password)
        path = self._role_path + self._sanitize_key(role_name)
        self.api_execute(path, self._MDELETE)

__init__(host='127.0.0.1', port=2379, version_prefix='/v2', read_timeout=10, allow_redirect=True, protocol='http', allow_reconnect=True, basic_auth_account=None)

Etcd client class. :param host: Mixed, if a str, it is the IP to connect to. If a tuple or list, like ((ip, port), (ip, port)). Defaults to 127.0.0.1. :param port: Type is int, the port used to connect to etcd server. Defaults to 2379. :param version_prefix: Type is str, url or version prefix in etcd url. Defaults to v2. :param read_timeout: Type is int, max seconds to wait for a request. Defaults to 10. :param allow_redirect: Type is bool, allow the client to connect other nodes. Defaults to True. :param protocol: Type is str, right now only support http. Defaults to http. :param allow_reconnect: Type is bool, allow the client to reconnect to another etcd server in the cluster in the case the default one does not respond. Defaults to True. :param basic_auth_account: Type is str, the authorization information. Defaults to None.

Source code in k3etcd/client.py
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
def __init__(
    self,
    host="127.0.0.1",
    port=2379,
    version_prefix="/v2",
    read_timeout=10,
    allow_redirect=True,
    protocol="http",
    allow_reconnect=True,
    basic_auth_account=None,
):
    """
    Etcd client class.
    :param host: Mixed, if a `str`, it is the IP to connect to.
    If a `tuple` or `list`, like `((ip, port), (ip, port))`.
    Defaults to `127.0.0.1`.
    :param port: Type is `int`, the port used to connect to etcd server.
    Defaults to `2379`.
    :param version_prefix: Type is `str`, url or version prefix in etcd url. Defaults to `v2`.
    :param read_timeout: Type is `int`, max seconds to wait for a request. Defaults to `10`.
    :param allow_redirect: Type is `bool`, allow the client to connect other nodes. Defaults to `True`.
    :param protocol: Type is `str`, right now only support http. Defaults to `http`.
    :param allow_reconnect: Type is `bool`, allow the client to reconnect to another etcd server
    in the cluster in the case the default one does not respond. Defaults to `True`.
    :param basic_auth_account: Type is `str`, the authorization information. Defaults to `None`.
    """
    self._protocol = protocol
    if protocol == "https":
        raise EtcdSSLError("not supported https right now")

    self._machines_cache = []
    if not list_type(host):
        self._host = host
        self._port = int(port)
        self._base_uri = "%s://%s:%d" % (self._protocol, self._host, self._port)
    else:
        for h in host:
            if list_type(h):
                _h, _p = (list(h) + [int(port)])[:2]
            else:
                _h, _p = h, int(port)
            self._machines_cache.append("%s://%s:%d" % (self._protocol, _h, _p))

        self._base_uri = self._machines_cache.pop(0)
        _, self._host, self._port = self._extract_base_uri()

    self.version_prefix = version_prefix
    self._keys_path = self.version_prefix + "/keys"
    self._stats_path = self.version_prefix + "/stats"
    self._mem_path = self.version_prefix + "/members"
    self._user_path = self.version_prefix + "/auth/users"
    self._role_path = self.version_prefix + "/auth/roles"
    self._read_timeout = read_timeout
    self._allow_redirect = allow_redirect
    self._allow_reconnect = allow_reconnect
    self.basic_auth_account = basic_auth_account

    if self._allow_reconnect:
        if len(self._machines_cache) <= 0:
            self._machines_cache = self.machines
        if self._base_uri in self._machines_cache:
            self._machines_cache.remove(self._base_uri)
    else:
        self._machines_cache = []

add_member(*peerurls)

Add a new node in the cluster.

Raise a etcd.EtcdResponseError if the cluster fails to process the request.

Raise a etcd.EtcdException if the member exists in the cluster or existed in the cluster at some point in the past or any of the given peerURLs exists in the cluster. :param peerurls: The new node peerurls. Type is list, like['http://127.0.0.1:2380',] :return: A dick

Source code in k3etcd/client.py
1313
1314
1315
1316
1317
1318
1319
1320
1321
1322
1323
1324
1325
1326
1327
1328
1329
1330
1331
1332
def add_member(self, *peerurls):
    """
    Add a new node in the cluster.

    Raise a `etcd.EtcdResponseError` if the cluster fails to process the request.

    Raise a `etcd.EtcdException` if the member exists in the cluster
    or existed in the cluster at some point in the past
    or any of the given peerURLs exists in the cluster.
    :param peerurls: The new node peerurls.
    Type is `list`, like`['http://127.0.0.1:2380',]`
    :return: A `dick`
    """
    if len(peerurls) == 0:
        raise EtcdException("no peer url found")

    data = {"peerURLs": peerurls}
    response = self.api_execute(self._mem_path, self._MPOST, params=data, bodyinjson=True)

    return self._to_dict(response)

change_peerurls(mid, *peerurls)

Change the peer urls of a given member. :param mid: The id of the node in the cluster. :param peerurls: The peerurls that will be set to the member. Type is list, like['http://127.0.0.1:2380',] :return: nothing

Source code in k3etcd/client.py
1347
1348
1349
1350
1351
1352
1353
1354
1355
1356
1357
1358
1359
1360
1361
1362
1363
1364
1365
def change_peerurls(self, mid, *peerurls):
    """
    Change the peer urls of a given member.
    :param mid: The id of the node in the cluster.
    :param peerurls: The peerurls that will be set to the member.
    Type is `list`, like`['http://127.0.0.1:2380',]`
    :return: nothing
    """
    if mid not in self.ids:
        logger.info("{mid} not in the cluster when change peerurls".format(mid=mid))
        return

    if len(peerurls) == 0:
        raise EtcdException("no peer url found")

    mid = self._sanitize_key(mid)
    data = {"peerURLs": peerurls}

    self.api_execute(self._mem_path + mid, self._MPUT, params=data, bodyinjson=True)

create_role(name, root_password, permissions=None)

Create a role in the cluster. :param name: The name of the role. :param root_password: The password of the root user. :param permissions: A dict, like{'read': ['/*'], 'write': ['/*']}. Defaults to None. :return: A dict, like{"role":"w_role","permissions":{"kv":{"read":["/*"],"write":["/*"]}}}

Source code in k3etcd/client.py
1420
1421
1422
1423
1424
1425
1426
1427
1428
1429
1430
1431
1432
1433
1434
1435
1436
1437
def create_role(self, name, root_password, permissions=None):
    """
    Create a role in the cluster.
    :param name: The name of the role.
    :param root_password: The password of the root user.
    :param permissions: A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
    Defaults to `None`.
    :return: A `dict`, like`{"role":"w_role","permissions":{"kv":{"read":["/*"],"write":["/*"]}}}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._role_path + self._sanitize_key(name)
    if permissions is not None:
        params = {"role": name, "permissions": {"kv": permissions}}
    else:
        params = {"role": name}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

create_root(password)

Create root user in the cluster. :param password: The password of the root user. :return: A dict, like{"user":"root","roles":["root"]}

Source code in k3etcd/client.py
1370
1371
1372
1373
1374
1375
1376
1377
1378
1379
1380
def create_root(self, password):
    """
    Create root user in the cluster.
    :param password: The password of the root user.
    :return: A `dict`, like`{"user":"root","roles":["root"]}`
    """
    path = self._user_path + "/root"
    params = {"user": "root", "password": password}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

create_user(name, password, root_password, roles=None)

Create a user in the cluster. :param name: The name of the user. :param password: The password of user. :param root_password: The password of the root user. :param roles: The roles that will be granted to the user. A list, like['r1', 'r2']. Defaults to None. :return: A dict, like{"user":"u1","roles":['r1']}

Source code in k3etcd/client.py
1400
1401
1402
1403
1404
1405
1406
1407
1408
1409
1410
1411
1412
1413
1414
1415
1416
1417
1418
def create_user(self, name, password, root_password, roles=None):
    """
    Create a user in the cluster.
    :param name: The name of the user.
    :param password: The password of user.
    :param root_password: The password of the root user.
    :param roles: The roles that will be granted to the user.
    A `list`, like`['r1', 'r2']`. Defaults to `None`.
    :return: A `dict`, like`{"user":"u1","roles":['r1']}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._user_path + self._sanitize_key(name)
    if roles is not None:
        params = {"user": name, "password": password, "roles": roles}
    else:
        params = {"user": name, "password": password}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

del_member(mid)

Remove a member from the cluster. :param mid: The id of the node in the cluster. :return: nothing

Source code in k3etcd/client.py
1334
1335
1336
1337
1338
1339
1340
1341
1342
1343
1344
1345
def del_member(self, mid):
    """
    Remove a member from the cluster.
    :param mid: The id of the node in the cluster.
    :return: nothing
    """
    if mid not in self.ids:
        logger.info("{mid} not in the cluster when delete member".format(mid=mid))
        return

    mid = self._sanitize_key(mid)
    self.api_execute(self._mem_path + mid, self._MDELETE)

deldir(key, **argkv)

Delete a dir in cluster with key. :param key: The key that will be deleted. See key in etcd.Client.delete. :param argkv: :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1292
1293
1294
1295
1296
1297
1298
1299
1300
def deldir(self, key, **argkv):
    """
    Delete a dir in cluster with `key`.
    :param key: The key that will be deleted.
    See `key` in `etcd.Client.delete`.
    :param argkv:
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.delete(key, dir=True, **argkv)

delete(key, recursive=None, dir=None, **argkv)

Remove a key from etcd. :param key: The key which will be delete. :param recursive: If we want to recursively delete a directory, set it to True. Defaults to None. :param dir: If we want to delete a directory, set it to True. Defaults to None. :param argkv: Other kv args. prevValue: Compare with this value and delete only if corresponding (optional). prevIndex(int): Delete only if actual modifiedIndex matches the provided one (optional). :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1133
1134
1135
1136
1137
1138
1139
1140
1141
1142
1143
1144
1145
1146
1147
1148
1149
1150
1151
1152
1153
1154
1155
1156
1157
1158
1159
1160
1161
def delete(self, key, recursive=None, dir=None, **argkv):
    """
    Remove a key from etcd.
    :param key: The key which will be delete.
    :param recursive: If we want to recursively delete a directory, set it to `True`.
    Defaults to `None`.
    :param dir: If we want to delete a directory, set it to `True`.
    Defaults to `None`.
    :param argkv: Other kv args.
    `prevValue`:
    Compare with this value and delete only if corresponding (optional).
    `prevIndex(int)`:
    Delete only if actual modifiedIndex matches the provided one (optional).
    :return: A `etcd.EtcdKeysResult` object.
    """
    key = self._sanitize_key(key)

    params = {}
    if recursive is not None:
        params["recursive"] = recursive and "true" or "false"

    if dir is not None:
        params["dir"] = dir and "true" or "false"

    params.update(self._generate_params(self._del_conditions, argkv))

    response = self.api_execute(self._keys_path + key, self._MDELETE, params=params)

    return self._to_keysresult(response)

delete_role(role_name, root_password)

Delete the role of the cluster. :param role_name: The name of the role. :param root_password: The password of the root user. :return: nothing

Source code in k3etcd/client.py
1567
1568
1569
1570
1571
1572
1573
1574
1575
1576
def delete_role(self, role_name, root_password):
    """
    Delete the role of the cluster.
    :param role_name: The name of the role.
    :param root_password: The password of the root user.
    :return: nothing
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._role_path + self._sanitize_key(role_name)
    self.api_execute(path, self._MDELETE)

delete_user(user_name, root_password)

Delete the user of the cluster. :param user_name: The name of the user. :param root_password: The password of the root user. :return: nothing

Source code in k3etcd/client.py
1556
1557
1558
1559
1560
1561
1562
1563
1564
1565
def delete_user(self, user_name, root_password):
    """
    Delete the user of the cluster.
    :param user_name: The name of the user.
    :param root_password: The password of the root user.
    :return: nothing
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._user_path + self._sanitize_key(user_name)
    self.api_execute(path, self._MDELETE)

disable_auth(root_password)

Disable authorization. :param root_password: The password of the root user. :return: nothing

Source code in k3etcd/client.py
1391
1392
1393
1394
1395
1396
1397
1398
def disable_auth(self, root_password):
    """
    Disable authorization.
    :param root_password: The password of the root user.
    :return: nothing
    """
    self.basic_auth_account = self._root_auth(root_password)
    self.api_execute("/v2/auth/enable", self._MDELETE)

enable_auth(root_password)

Enable authorization. :param root_password: The password of the root user. :return: nothing

Source code in k3etcd/client.py
1382
1383
1384
1385
1386
1387
1388
1389
def enable_auth(self, root_password):
    """
    Enable authorization.
    :param root_password: The password of the root user.
    :return: nothing
    """
    self.basic_auth_account = self._root_auth(root_password)
    self.api_execute("/v2/auth/enable", self._MPUT)

eternal_watch(key, waitindex=None, until=None, **argkv)

Blocks until the modify index of the key is ge than until. :param key: See key in etcd.Client.watch. :param waitindex: See waitindex in etcd.Client.watch. :param until: Break the loop when the modify index of the key is ge than it. If None, the loop will not be break. Defaults to None :param argkv: See other kv args in etcd.Client.watch. :return: It is an iterator. Each element is a etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1232
1233
1234
1235
1236
1237
1238
1239
1240
1241
1242
1243
1244
1245
1246
1247
1248
1249
1250
1251
1252
1253
def eternal_watch(self, key, waitindex=None, until=None, **argkv):
    """
    Blocks until the modify index of the key is ge than `until`.
    :param key: See `key` in `etcd.Client.watch`.
    :param waitindex: See `waitindex` in `etcd.Client.watch`.
    :param until: Break the loop when the modify index of the key is ge than it.
    If `None`, the loop will not be break. Defaults to `None`
    :param argkv: See other kv args in `etcd.Client.watch`.
    :return: It is an iterator. Each element is a `etcd.EtcdKeysResult` object.
    """
    local_index = waitindex
    while True:
        res = self._watch(key, waitindex=local_index, timeout=0, **argkv)
        if until is not None and res.modifiedIndex is not None:
            if res.modifiedIndex >= until:
                yield res
                return

        if local_index is not None:
            local_index = (res.modifiedIndex or local_index) + 1

        yield res

get_role(name, root_password)

Get the role information of the cluster. :param name: The name of the role. if None, return all roles information. :param root_password: The password of the root user. :return: a dict

Source code in k3etcd/client.py
1475
1476
1477
1478
1479
1480
1481
1482
1483
1484
1485
1486
1487
1488
1489
1490
def get_role(self, name, root_password):
    """
    Get the role information of the cluster.
    :param name: The name of the role.
    if `None`, return all roles information.
    :param root_password: The password of the root user.
    :return: a dict
    """
    self.basic_auth_account = self._root_auth(root_password)
    if name is not None:
        path = self._role_path + self._sanitize_key(name)
    else:
        path = self._role_path

    res = self.api_execute(path, self._MGET)
    return self._to_dict(res)

get_user(name, root_password)

Get the user information of the cluster. :param name: The name of the user. if None, return all users information.

:param root_password: The password of the root user. :return: A dict

Source code in k3etcd/client.py
1439
1440
1441
1442
1443
1444
1445
1446
1447
1448
1449
1450
1451
1452
1453
1454
1455
1456
1457
1458
1459
1460
1461
1462
1463
1464
1465
1466
1467
1468
1469
1470
1471
1472
1473
def get_user(self, name, root_password):
    """
    Get the user information of the cluster.
    :param name: The name of the user.
    if `None`, return all users information.

    :param root_password: The password of the root user.
    :return: A `dict`
    """
    # {
    #     "user": "root",
    #     "roles": [
    #         {
    #             "role": "root",
    #             "permissions": {
    #                 "kv": {
    #                     "read": [
    #                         "/*"
    #                     ],
    #                     "write": [
    #                         "/*"
    #                     ]
    #                 }
    #             }
    #         }
    #     ]
    # }
    self.basic_auth_account = self._root_auth(root_password)
    if name is not None:
        path = self._user_path + self._sanitize_key(name)
    else:
        path = self._user_path

    res = self.api_execute(path, self._MGET)
    return self._to_dict(res)

grant_role_permissions(name, root_password, permissions)

Grant permissions to the role. :param name: The name of the role. :param root_password: The password of the root user. :param permissions: The permissions that will be granted to the role. A dict, like{'read': ['/*'], 'write': ['/*']}. :return: A dict, like{u'role': u'r_test', u'permissions': {u'kv': {u'read': [u'/*'], u'write': []}}}

Source code in k3etcd/client.py
1524
1525
1526
1527
1528
1529
1530
1531
1532
1533
1534
1535
1536
1537
1538
def grant_role_permissions(self, name, root_password, permissions):
    """
    Grant permissions to the role.
    :param name: The name of the role.
    :param root_password: The password of the root user.
    :param permissions: The permissions that will be granted to the role.
    A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
    :return: A `dict`, like`{u'role': u'r_test', u'permissions': {u'kv': {u'read': [u'/*'], u'write': []}}}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._role_path + self._sanitize_key(name)
    params = {"role": name, "grant": {"kv": permissions}}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

grant_user_roles(name, root_password, roles)

Grant roles to user. :param name: The name of the user. :param root_password: The password of the root user. :param roles: The roles that will be granted to the user. A list, like['r1', 'r2']. :return: A dict, like{u'user': u'u_test', u'roles': [u'r_test']}

Source code in k3etcd/client.py
1492
1493
1494
1495
1496
1497
1498
1499
1500
1501
1502
1503
1504
1505
1506
def grant_user_roles(self, name, root_password, roles):
    """
    Grant roles to user.
    :param name: The name of the user.
    :param root_password: The password of the root user.
    :param roles: The roles that will be granted to the user.
    A `list`, like`['r1', 'r2']`.
    :return: A `dict`, like`{u'user': u'u_test', u'roles': [u'r_test']}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._user_path + self._sanitize_key(name)
    params = {"user": name, "grant": roles}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

lsdir(key, **argkv)

Get all nodes of the dir with key. :param key: The key that will be got. See key in etcd.Client.read. :param argkv: :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1278
1279
1280
1281
1282
1283
1284
1285
1286
def lsdir(self, key, **argkv):
    """
    Get all nodes of the dir with `key`.
    :param key: The key that will be got.
    See `key` in `etcd.Client.read`.
    :param argkv:
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.read(key, **argkv)

mkdir(key, ttl=None, **argkv)

Create a dir in the cluster. :param key: The key that will be created. :param ttl: Time in seconds of expiration. See ttl in etcd.Client.write. :param argkv: :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1255
1256
1257
1258
1259
1260
1261
1262
1263
1264
def mkdir(self, key, ttl=None, **argkv):
    """
    Create a dir in the cluster.
    :param key: The key that will be created.
    :param ttl: Time in seconds of expiration.
    See `ttl` in `etcd.Client.write`.
    :param argkv:
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.write(key, ttl=ttl, dir=True, **argkv)

rdeldir(key, **argkv)

Delete a dir in cluster with key recursively. :param key: The key that will be deleted. See key in etcd.Client.delete. :param argkv: :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1302
1303
1304
1305
1306
1307
1308
1309
1310
1311
def rdeldir(self, key, **argkv):
    """
    Delete a dir in cluster with `key` recursively.
    :param key: The key that will be deleted.
    See `key` in `etcd.Client.delete`.
    :param argkv:
    :return: A `etcd.EtcdKeysResult` object.
    """
    argkv["recursive"] = True
    return self.delete(key, dir=True, **argkv)

read(key, **argkv)

Get the value with key :param key: The key which wil be accessed. /XXX is same as XXX. :param argkv: Other kv args.

recursive(bool): Fetch a dir recursively.

wait(bool): Wait and return next time the key is changed.

waitIndex(int): The index to fetch results from.

sorted(bool): Sort the output keys.

quorum(bool): If True, get value through raft.

timeout(int): Max seconds to wait for the request. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1008
1009
1010
1011
1012
1013
1014
1015
1016
1017
1018
1019
1020
1021
1022
1023
1024
1025
1026
1027
1028
1029
1030
1031
1032
1033
1034
1035
1036
1037
1038
def read(self, key, **argkv):
    """
    Get the value with `key`
    :param key: The key which wil be accessed. `/XXX` is same as `XXX`.
    :param argkv: Other kv args.

    `recursive(bool)`:
    Fetch a dir recursively.

    `wait(bool)`:
    Wait and return next time the key is changed.

    `waitIndex(int)`:
    The index to fetch results from.

    `sorted(bool)`:
    Sort the output keys.

    `quorum(bool)`:
    If `True`, get value through raft.

    `timeout(int)`:
    Max seconds to wait for the request.
    :return: A `etcd.EtcdKeysResult` object.
    """
    key = self._sanitize_key(key)
    params = self._generate_params(self._read_options, argkv)
    timeout = argkv.get("timeout")
    response = self.api_execute(self._keys_path + key, self._MGET, params=params, timeout=timeout)

    return self._to_keysresult(response)

refresh(key, ttl=None, **argkv)

Update the ttl of the key. :param key: See key in etcd.Client.write. :param ttl: Time in seconds of expiration. See ttl in etcd.Client.write. :param argkv: :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1266
1267
1268
1269
1270
1271
1272
1273
1274
1275
1276
def refresh(self, key, ttl=None, **argkv):
    """
    Update the `ttl` of the `key`.
    :param key: See `key` in `etcd.Client.write`.
    :param ttl: Time in seconds of expiration.
    See `ttl` in `etcd.Client.write`.
    :param argkv:
    :return: A `etcd.EtcdKeysResult` object.
    """
    argkv["prevExist"] = True
    return self.write(key, ttl=ttl, refresh=True, **argkv)

revoke_role_permissions(name, root_password, permissions)

Revoke permissions from the role. :param name: The name of the role. :param root_password: The password of the root user. :param permissions: The permissions that will be granted to the role. A dict, like{'read': ['/*'], 'write': ['/*']}. :return: A dict, like{u'role': u'r_test', u'permissions': {u'kv': {u'read': [], u'write': []}}}

Source code in k3etcd/client.py
1540
1541
1542
1543
1544
1545
1546
1547
1548
1549
1550
1551
1552
1553
1554
def revoke_role_permissions(self, name, root_password, permissions):
    """
    Revoke permissions from the role.
    :param name: The name of the role.
    :param root_password: The password of the root user.
    :param permissions: The permissions that will be granted to the role.
    A `dict`, like`{'read': ['/*'], 'write': ['/*']}`.
    :return: A `dict`, like`{u'role': u'r_test', u'permissions': {u'kv': {u'read': [], u'write': []}}}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._role_path + self._sanitize_key(name)
    params = {"role": name, "revoke": {"kv": permissions}}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

revoke_user_roles(name, root_password, roles)

Grant roles to user. :param name: The name of the user. :param root_password: The password of the root user. :param roles: The roles that will be revoked from the user. A list, like['r1', 'r2']. :return: A dict, like{u'user': u'u_test', u'roles': []}

Source code in k3etcd/client.py
1508
1509
1510
1511
1512
1513
1514
1515
1516
1517
1518
1519
1520
1521
1522
def revoke_user_roles(self, name, root_password, roles):
    """
    Grant roles to user.
    :param name: The name of the user.
    :param root_password: The password of the root user.
    :param roles: The roles that will be revoked from the user.
    A `list`, like`['r1', 'r2']`.
    :return: A `dict`, like`{u'user': u'u_test', u'roles': []}`
    """
    self.basic_auth_account = self._root_auth(root_password)
    path = self._user_path + self._sanitize_key(name)
    params = {"user": name, "revoke": roles}

    res = self.api_execute(path, self._MPUT, params=params, bodyinjson=True)
    return self._to_dict(res)

set(key, value, ttl=None)

Set value with key. :param key: See key in etcd.Client.write. :param value: See value in etcd.Client.write. :param ttl: See ttl in etcd.Client.write. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1101
1102
1103
1104
1105
1106
1107
1108
1109
def set(self, key, value, ttl=None):
    """
    Set `value` with `key`.
    :param key: See `key` in `etcd.Client.write`.
    :param value: See `value` in `etcd.Client.write`.
    :param ttl: See `ttl` in `etcd.Client.write`.
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.write(key, value=value, ttl=ttl)

test_and_delete(key, **argkv)

Remove a key from etcd. :param key: The key which will be delete. :param argkv: See other kv args in etcd.Client.delete. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1163
1164
1165
1166
1167
1168
1169
1170
def test_and_delete(self, key, **argkv):
    """
    Remove a key from etcd.
    :param key: The key which will be delete.
    :param argkv: See other kv args in `etcd.Client.delete`.
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.delete(key, **argkv)

test_and_set(key, value, ttl=None, **argkv)

Set value with key. :param key: See key in etcd.Client.write. :param value: See value in etcd.Client.write. :param ttl: See ttl in etcd.Client.write. :param argkv: See other kv args in etcd.Client.write. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1090
1091
1092
1093
1094
1095
1096
1097
1098
1099
def test_and_set(self, key, value, ttl=None, **argkv):
    """
    Set `value` with `key`.
    :param key: See `key` in `etcd.Client.write`.
    :param value: See `value` in `etcd.Client.write`.
    :param ttl: See `ttl` in `etcd.Client.write`.
    :param argkv: See other kv args in `etcd.Client.write`.
    :return: A `etcd.EtcdKeysResult` object.
    """
    return self.write(key, value=value, ttl=ttl, **argkv)

update(res)

Updates the value for a key atomically. :param res: A etcd.EtcdKeysResult object. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1111
1112
1113
1114
1115
1116
1117
1118
1119
1120
1121
1122
1123
1124
1125
1126
1127
1128
1129
1130
1131
def update(self, res):
    """
    Updates the value for a key atomically.
    :param res: A `etcd.EtcdKeysResult` object.
    :return: A `etcd.EtcdKeysResult` object.
    """
    # c = etcd.Client(host=hosts)
    # res = c.read("/somekey")
    # res.value += 1
    # c.update(res)
    argkv = {
        "dir": res.dir,
        "ttl": res.ttl,
        "prevExist": True,
    }

    if not res.dir:
        # prevIndex on a dir causes a 'not a file' error. d'oh!
        argkv["prevIndex"] = res.modifiedIndex

    return self.write(res.key, value=res.value, **argkv)

watch(key, waitindex=None, timeout=None, **argkv)

Blocks until a new event has been received or timeout. Raise a etcd.EtcdReadTimeoutError if timeout. :param key: The key which will be watched. :param waitindex: Index to start from. Type is int. Defautls to None. If None use the newest index. :param timeout: Max seconds to wait. If None, use etcd.Client.read_timeout. If 0 means infinite waiting. :param argkv: Other kv args. recursive(bool) If want to watch a dir, set True. waitIndex(int): If waitindex is None, use it. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1172
1173
1174
1175
1176
1177
1178
1179
1180
1181
1182
1183
1184
1185
1186
1187
1188
1189
1190
1191
1192
1193
1194
1195
1196
1197
1198
1199
def watch(self, key, waitindex=None, timeout=None, **argkv):
    """
    Blocks until a new event has been received or timeout.
    Raise a `etcd.EtcdReadTimeoutError` if timeout.
    :param key: The key which will be watched.
    :param waitindex:     Index to start from.
    Type is `int`. Defautls to `None`.
    If `None` use the newest index.
    :param timeout: Max seconds to wait.
    If `None`, use `etcd.Client.read_timeout`.
    If `0` means infinite waiting.
    :param argkv: Other kv args.
    `recursive(bool)`
    If want to watch a dir, set `True`.
    `waitIndex(int)`:
    If `waitindex` is `None`, use it.
    :return: A `etcd.EtcdKeysResult` object.
    """
    newest_v = self.get(key)

    if waitindex is None:
        waitindex = argkv.get("waitIndex")

    if waitindex is not None and 0 < waitindex <= newest_v.modifiedIndex:
        return newest_v
    else:
        waitindex = newest_v.etcd_index + 1
        return self._watch(key, waitindex, timeout, **argkv)

write(key, value=None, ttl=None, dir=False, append=False, refresh=False, **argkv)

Writes the value for a key, possibly doing atomic Compare-and-Swap. Raise a etcd.EtcdRequestError when value is not None and dir is True. :param key: The key that will be writen. /XXX is same as XXX. :param value: Value to set. Defaults to None. :param ttl: Time in seconds of expiration (optional). Type is int. Defaults to None. :param dir: Set to True if we are writing a directory. Type is bool. Defaults to False. :param append: If True, it will post to append the new value to the dir, creating a sequential key. Defaults to false. :param refresh: If True, only update the ttl, prev key must existed(prevExist=True). :param argkv: Other kv args. prevValue: Compare with this value, and swap only if corresponding (optional). prevIndex(int): Modify key only if actual modifiedIndex matches the provided one (optional). prevExist(bool): If False, only create key; if True, only update key. :return: A etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
1042
1043
1044
1045
1046
1047
1048
1049
1050
1051
1052
1053
1054
1055
1056
1057
1058
1059
1060
1061
1062
1063
1064
1065
1066
1067
1068
1069
1070
1071
1072
1073
1074
1075
1076
1077
1078
1079
1080
1081
1082
1083
1084
1085
1086
1087
1088
def write(self, key, value=None, ttl=None, dir=False, append=False, refresh=False, **argkv):
    """
    Writes the value for a key, possibly doing atomic Compare-and-Swap.
    Raise a `etcd.EtcdRequestError` when `value is not None` and `dir is True`.
    :param key: The key that will be writen.
    `/XXX` is same as `XXX`.
    :param value: Value to set. Defaults to `None`.
    :param ttl: Time in seconds of expiration (optional).
    Type is `int`. Defaults to `None`.
    :param dir: Set to `True` if we are writing a directory.
    Type is `bool`. Defaults to `False`.
    :param append: If `True`, it will post to append the new value to the dir, creating a sequential key.
    Defaults to false.
    :param refresh: If `True`, only update the ttl, prev key must existed(`prevExist=True`).
    :param argkv: Other kv args.
    `prevValue`: Compare with this value, and swap only if corresponding (optional).
    `prevIndex(int)`: Modify key only if actual modifiedIndex matches the provided one (optional).
    `prevExist(bool)`: If `False`, only create key; if `True`, only update key.
    :return: A `etcd.EtcdKeysResult` object.
    """
    key = self._sanitize_key(key)

    params = {}
    if ttl is not None:
        params["ttl"] = ttl

    if dir and value is not None:
        raise EtcdRequestError("Cannot create a directory with a value " + repr(value))
    elif value is not None:
        params["value"] = value
    elif dir:
        params["dir"] = "true"

    if refresh:
        params["refresh"] = "true"

    params.update(self._generate_params(self._write_conditions, argkv))

    method = append and self._MPOST or self._MPUT
    if "_endpoint" in argkv:
        path = argkv["_endpoint"] + key
    else:
        path = self._keys_path + key

    response = self.api_execute(path, method, params=params)

    return self._to_keysresult(response)

EcodeDirNotEmpty

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if delete a not empty dir with recursive=false.

Source code in k3etcd/client.py
180
181
182
183
184
185
186
class EcodeDirNotEmpty(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if delete a not empty dir with `recursive=false`.
    """

    pass

EcodeIndexNaN

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if the given index in post form is not a number.

Source code in k3etcd/client.py
207
208
209
210
211
212
213
class EcodeIndexNaN(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if the given `index` in post form is not a number.
    """

    pass

EcodeInscientPermissions

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if Unauthorized.

Source code in k3etcd/client.py
234
235
236
237
238
239
240
class EcodeInscientPermissions(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if Unauthorized.
    """

    pass

EcodeInvalidField

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if the http header field is invalid.

Source code in k3etcd/client.py
216
217
218
219
220
221
222
class EcodeInvalidField(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if the http header field is invalid.
    """

    pass

EcodeInvalidForm

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if post form is invalid.

Source code in k3etcd/client.py
225
226
227
228
229
230
231
class EcodeInvalidForm(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if post form is invalid.
    """

    pass

EcodeKeyNotFound

Bases: EtcdKeyError

A subclass of etcd.EtcdKeyError. Raise if key not found.

Source code in k3etcd/client.py
124
125
126
127
128
129
130
class EcodeKeyNotFound(EtcdKeyError):
    """
    A subclass of `etcd.EtcdKeyError`.
    Raise if key not found.
    """

    pass

EcodeNodeExist

Bases: EtcdKeyError

A subclass of etcd.EtcdKeyError. Raise if create a existed key with prevExist=False.

Source code in k3etcd/client.py
162
163
164
165
166
167
168
class EcodeNodeExist(EtcdKeyError):
    """
    A subclass of `etcd.EtcdKeyError`.
    Raise if create a existed key with `prevExist=False`.
    """

    pass

EcodeNotDir

Bases: EtcdKeyError

A subclass of etcd.EtcdKeyError. Raise if the dir operation to a file.

Source code in k3etcd/client.py
153
154
155
156
157
158
159
class EcodeNotDir(EtcdKeyError):
    """
    A subclass of `etcd.EtcdKeyError`.
    Raise if the dir operation to a file.
    """

    pass

EcodeNotFile

Bases: EtcdKeyError

A subclass of etcd.EtcdKeyError. Raise if the file operation to a dir.

Source code in k3etcd/client.py
143
144
145
146
147
148
149
150
class EcodeNotFile(EtcdKeyError):
    """
    A subclass of `etcd.EtcdKeyError`.
    Raise if the file operation to a dir.

    """

    pass

EcodePrevValueRequired

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if not provide prevValue when it is required in post form.

Source code in k3etcd/client.py
189
190
191
192
193
194
195
class EcodePrevValueRequired(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if not provide `prevValue` when it is required in post form.
    """

    pass

EcodeRootROnly

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if root is read only.

Source code in k3etcd/client.py
171
172
173
174
175
176
177
class EcodeRootROnly(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if root is read only.
    """

    pass

EcodeTTLNaN

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if the given TTL in post form is not a number.

Source code in k3etcd/client.py
198
199
200
201
202
203
204
class EcodeTTLNaN(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if the given `TTL` in post form is not a number.
    """

    pass

EcodeTestFailed

Bases: EtcdValueError

A subclass of etcd.EtcdValueError. Raise if compare failed. Such as prevValue=abc compare failed in the cluster.

Source code in k3etcd/client.py
133
134
135
136
137
138
139
140
class EcodeTestFailed(EtcdValueError):
    """
    A subclass of `etcd.EtcdValueError`.
    Raise if compare failed.
    Such as `prevValue=abc` compare failed in the cluster.
    """

    pass

EtcdException

Bases: Exception

The base class of the other exceptions in this module. It is a subclass of Exception.

Source code in k3etcd/client.py
18
19
20
21
22
23
24
class EtcdException(Exception):
    """
    The base class of the other exceptions in this module.
    It is a subclass of `Exception`.
    """

    pass

EtcdIncompleteRead

Bases: EtcdResponseError

A subclass of etcd.EtcdException. Raise if the encoding of response body is not json.

Source code in k3etcd/client.py
73
74
75
76
77
78
79
class EtcdIncompleteRead(EtcdResponseError):
    """
    A subclass of `etcd.EtcdException`.
    Raise if the encoding of response body is not json.
    """

    pass

EtcdInternalError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if etcd server "Raft Internal Error" or "During Leader Election".

Source code in k3etcd/client.py
27
28
29
30
31
32
33
class EtcdInternalError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if etcd server "Raft Internal Error" or "During Leader Election".
    """

    pass

EtcdKeyError

Bases: EtcdException, KeyError

A subclass of etcd.EtcdException and KeyError. The base class of etcd.EcodeKeyNotFound, etcd.EcodeNotFile, etcd.EcodeNotDir and etcd.EcodeNodeExist in this module.

Source code in k3etcd/client.py
102
103
104
105
106
107
108
109
class EtcdKeyError(EtcdException, KeyError):
    """
    A subclass of `etcd.EtcdException` and `KeyError`.
    The base class of `etcd.EcodeKeyNotFound`, `etcd.EcodeNotFile`,
    `etcd.EcodeNotDir` and `etcd.EcodeNodeExist` in this module.
    """

    pass

EtcdKeysResult

Bases: object

etcd.EtcdKeysResult.expiration

Type is str, the current node expire time. Defaults to None.

etcd.EtcdKeysResult.ttl

The left seconds of the current node. If None, it is a permanent node. Defaults to None.

etcd.EtcdKeysResult.modifiedIndex

Type is int, modified index of the node returned from server.

etcd.EtcdKeysResult.createdIndex

Type is int, created index of the node returned from server.

etcd.EtcdKeysResult.newKey

Whether the node is created in this request. Type is bool, defaults to False.

etcd.EtcdKeysResult.dir

Whether the node is a dir or not. Type is bool, defaults to False.

etcd.EtcdKeysResult.leaves

The nodes which have value. It is an iterator. Each element is a etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
class EtcdKeysResult(object):
    """
    `etcd.EtcdKeysResult.expiration`

    Type is `str`, the current node expire time. Defaults to `None`.

    ##  etcd.EtcdKeysResult.ttl

    The left seconds of the current node.
    If `None`, it is a permanent node. Defaults to `None`.

    ##  etcd.EtcdKeysResult.modifiedIndex

    Type is `int`, modified index of the node returned from server.

    ##  etcd.EtcdKeysResult.createdIndex


    Type is `int`, created index of the node returned from server.

    ##  etcd.EtcdKeysResult.newKey


    Whether the node is created in this request.
    Type is `bool`, defaults to `False`.

    ##  etcd.EtcdKeysResult.dir

    Whether the node is a dir or not.
    Type is `bool`, defaults to `False`.

    ##  etcd.EtcdKeysResult.leaves

    The nodes which have value.
    It is an iterator. Each element is a `etcd.EtcdKeysResult` object.
    """

    _node_props = {
        "key": None,
        "value": None,
        "expiration": None,
        "ttl": None,
        "modifiedIndex": None,
        "createdIndex": None,
        "newKey": False,
        "dir": False,
    }

    def __init__(self, action=None, node=None, prevNode=None, **argkv):
        self.action = action
        for key, default in self._node_props.items():
            if node is not None and key in node:
                setattr(self, key, node[key])
            else:
                setattr(self, key, default)

        self._children = []
        if self.dir and "nodes" in node:
            self._children = node["nodes"]

        if prevNode:
            self._prev_node = EtcdKeysResult(None, node=prevNode)
            """
            #fix this bug
            r = c.write('/foo', None, dir=True, ttl=50)
            print(r.dir) #True
            r2 = c.write('/foo', None, dir=True, ttl=120, prevExist=True)
            print(r2.dir) #False
            """
            if self._prev_node.dir and not self.dir:
                self.dir = True

    def parse_response(self, response):
        if response.status == http.client.CREATED:
            self.newKey = True

        headers = response.headers
        self.etcd_index = int(headers.get("x-etcd-index", 1))
        self.raft_index = int(headers.get("x-raft-index", 1))
        self.raft_term = int(headers.get("x-raft-term", 0))

    def get_subtree(self, leaves_only=False):
        """
        Get all the subtree resulting from a `recursive=true` call to etcd.
        :param leaves_only: If `True`, only value nodes are returned,
        else return all the nodes.

        :return: It is an iterator. Each element is a `etcd.EtcdKeysResult` object.
        """
        if not self._children:
            yield self
            return

        if not leaves_only:
            yield self

        for n in self._children:
            node = EtcdKeysResult(None, n)
            for child in node.get_subtree(leaves_only=leaves_only):
                yield child

        return

    @property
    def leaves(self):
        return self.get_subtree(leaves_only=True)

    def __eq__(self, other):
        """
        Compare one with another,
        if they are same, return `True`, else return `False`
        :return:
        """
        if not isinstance(other, EtcdKeysResult):
            return False

        for k in list(self._node_props.keys()):
            try:
                a = getattr(self, k)
                b = getattr(other, k)
                if a != b:
                    return False
            except Exception:
                return False

        return True

    def __ne__(self, other):
        """
        Compare one with another,
        if they are same, return `False`, else return `True`
        """
        return not self.__eq__(other)

    def __repr__(self):
        """
        Convert the object to a string and return it.
        """
        return "%s(%r)" % (self.__class__, self.__dict__)

__eq__(other)

Compare one with another, if they are same, return True, else return False :return:

Source code in k3etcd/client.py
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
def __eq__(self, other):
    """
    Compare one with another,
    if they are same, return `True`, else return `False`
    :return:
    """
    if not isinstance(other, EtcdKeysResult):
        return False

    for k in list(self._node_props.keys()):
        try:
            a = getattr(self, k)
            b = getattr(other, k)
            if a != b:
                return False
        except Exception:
            return False

    return True

__ne__(other)

Compare one with another, if they are same, return False, else return True

Source code in k3etcd/client.py
435
436
437
438
439
440
def __ne__(self, other):
    """
    Compare one with another,
    if they are same, return `False`, else return `True`
    """
    return not self.__eq__(other)

__repr__()

Convert the object to a string and return it.

Source code in k3etcd/client.py
442
443
444
445
446
def __repr__(self):
    """
    Convert the object to a string and return it.
    """
    return "%s(%r)" % (self.__class__, self.__dict__)

get_subtree(leaves_only=False)

Get all the subtree resulting from a recursive=true call to etcd. :param leaves_only: If True, only value nodes are returned, else return all the nodes.

:return: It is an iterator. Each element is a etcd.EtcdKeysResult object.

Source code in k3etcd/client.py
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
def get_subtree(self, leaves_only=False):
    """
    Get all the subtree resulting from a `recursive=true` call to etcd.
    :param leaves_only: If `True`, only value nodes are returned,
    else return all the nodes.

    :return: It is an iterator. Each element is a `etcd.EtcdKeysResult` object.
    """
    if not self._children:
        yield self
        return

    if not leaves_only:
        yield self

    for n in self._children:
        node = EtcdKeysResult(None, n)
        for child in node.get_subtree(leaves_only=leaves_only):
            yield child

    return

EtcdReadTimeoutError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if timeout when watching a key.

Source code in k3etcd/client.py
45
46
47
48
49
50
51
class EtcdReadTimeoutError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if timeout when watching a key.
    """

    pass

EtcdRequestError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if the http request is invalid. Such as invalid http request method or invalid headers.

Source code in k3etcd/client.py
54
55
56
57
58
59
60
61
class EtcdRequestError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if the http request is invalid.
    Such as invalid http request method or invalid headers.
    """

    pass

EtcdResponseError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if etcd server failed to process request.

Source code in k3etcd/client.py
64
65
66
67
68
69
70
class EtcdResponseError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if etcd server failed to process request.
    """

    pass

EtcdSSLError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if the protocol is https. Right now, this module don't support https.

Source code in k3etcd/client.py
82
83
84
85
86
87
88
89
class EtcdSSLError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if the protocol is `https`.
    Right now, this module don't support `https`.
    """

    pass

EtcdValueError

Bases: EtcdException, ValueError

A subclass of etcd.EtcdException and ValueError. The base class of etcd.EcodeTestFailed, etcd.EcodeRootROnly, etcd.EcodeDirNotEmpty, etcd.EcodePrevValueRequired, etcd.EcodeTTLNaN, etcd.EcodeIndexNaN, etcd.EcodeInvalidField and etcd.EcodeInvalidForm in this module.

Source code in k3etcd/client.py
112
113
114
115
116
117
118
119
120
121
class EtcdValueError(EtcdException, ValueError):
    """
    A subclass of `etcd.EtcdException` and `ValueError`.
    The base class of `etcd.EcodeTestFailed`, `etcd.EcodeRootROnly`,
    `etcd.EcodeDirNotEmpty`, `etcd.EcodePrevValueRequired`,
    `etcd.EcodeTTLNaN`, `etcd.EcodeIndexNaN`, `etcd.EcodeInvalidField` and
    `etcd.EcodeInvalidForm` in this module.
    """

    pass

EtcdWatchError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if "watcher is cleared due to etcd recovery" or "The event in requested index is outdated and cleared".

Source code in k3etcd/client.py
92
93
94
95
96
97
98
99
class EtcdWatchError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if "watcher is cleared due to etcd recovery"
    or "The event in requested index is outdated and cleared".
    """

    pass

NoMoreMachineError

Bases: EtcdException

A subclass of etcd.EtcdException. Raise if there are no machines left to try.

Source code in k3etcd/client.py
36
37
38
39
40
41
42
class NoMoreMachineError(EtcdException):
    """
    A subclass of `etcd.EtcdException`.
    Raise if there are no machines left to try.
    """

    pass

License

The MIT License (MIT) - Copyright (c) 2015 Zhang Yanpo (张炎泼)