1
0
Fork 0
mirror of https://github.com/chrislusf/seaweedfs synced 2025-08-19 02:22:48 +02:00

Commit graph

  • 1a20934823
    Merge branch 'master' into issue-6379-allow-empty-folder Chris Lu 2024-12-19 17:47:24 -08:00
  • 4d91ec359b
    Fix volume replica parallelization within ec.encode. (#6377) Lisandro Pin 2024-12-20 02:46:11 +01:00
  • 2b07216bc0 What problem are we solving? Fix: #6379 Warren Hodgkinson 2024-12-19 21:13:04 +00:00
  • ea303e8970
    Merge 2a47790773 into ba0707af64 Bruce Zou 2024-12-19 21:41:48 +08:00
  • 8b8cd31e21 Fix volume replica parallelization within ec.encode. Lisandro Pin 2024-12-18 23:15:40 +01:00
  • ba0707af64
    Allow configuring the maximum number of concurrent tasks for EC parallelization. (#6376) Lisandro Pin 2024-12-18 22:26:26 +01:00
  • 44c48c929a
    Parallelize volume replica operations within ec.encode. (#6374) Lisandro Pin 2024-12-18 20:59:48 +01:00
  • 72af97162f
    [shell] feat:stop vacuum immediately once volume.vacuum.disable was executed (#6375) dsd 2024-12-19 03:56:40 +08:00
  • eeb4fe00fd Allow configuring the maximum number of concurrent tasks for EC parallelization. Lisandro Pin 2024-12-18 18:19:02 +01:00
  • 480edf10da stop vacuum immediately once volume.vacuum.disable was executed dsd 2024-12-18 18:21:42 +08:00
  • 826edd5d6f Parallelize volume replica operations within ec.encode. Lisandro Pin 2024-12-17 19:39:58 +01:00
  • 9fbc4ea417
    Rework shell.EcBalance()'s waitgroup code into a standalone type. (#6373) Lisandro Pin 2024-12-17 18:39:51 +01:00
  • f6d613a70d Rework shell.EcBalance()'s waitgroup with errors code into a standalone type. Lisandro Pin 2024-12-17 18:10:45 +01:00
  • e77e50886e
    mount metacache add ttl (#6360) zemul 2024-12-17 12:19:32 +08:00
  • 6065b42e30 fix InodeEntry zemul 2024-12-17 11:00:56 +08:00
  • 178d5c3538
    Update weed/command/mount.go zemul 2024-12-17 10:45:16 +08:00
  • b2f26804a0
    chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 (#6369) dependabot[bot] 2024-12-16 14:09:26 -08:00
  • 52cf759a96
    chore(deps): bump golang.org/x/crypto from 0.30.0 to 0.31.0 (#6370) dependabot[bot] 2024-12-16 14:09:12 -08:00
  • 93da4fe4d5
    chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 (#6368) dependabot[bot] 2024-12-16 14:08:49 -08:00
  • 797fd2cea3
    chore(deps): bump golang.org/x/crypto from 0.30.0 to 0.31.0 dependabot[bot] 2024-12-16 20:29:39 +00:00
  • fa2d28c998
    chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 (#6367) dependabot[bot] 2024-12-16 12:29:07 -08:00
  • 641fbc7a80
    chore(deps): bump cloud.google.com/go/storage from 1.45.0 to 1.48.0 (#6366) dependabot[bot] 2024-12-16 12:28:56 -08:00
  • ab7b81bbad
    chore(deps): bump github.com/schollz/progressbar/v3 from 3.16.0 to 3.17.1 (#6365) dependabot[bot] 2024-12-16 12:28:43 -08:00
  • cbc3afe7d1
    chore(deps): bump go.mongodb.org/mongo-driver from 1.16.0 to 1.17.1 (#6364) dependabot[bot] 2024-12-16 12:28:32 -08:00
  • b4bcedf064
    chore(deps): bump github.com/getsentry/sentry-go from 0.29.1 to 0.30.0 (#6363) dependabot[bot] 2024-12-16 12:28:22 -08:00
  • 7a92b2cbb9
    chore(deps): bump github.com/fclairamb/ftpserverlib from 0.24.1 to 0.25.0 (#6362) dependabot[bot] 2024-12-16 12:28:11 -08:00
  • c1ff789adc
    chore(deps): bump docker/setup-buildx-action from 3.7.1 to 3.8.0 dependabot[bot] 2024-12-16 16:02:59 +00:00
  • 7f0954389a
    chore(deps): bump wangyoucao577/go-release-action from 1.52 to 1.53 dependabot[bot] 2024-12-16 16:02:55 +00:00
  • 0b8fad4071
    chore(deps): bump helm/kind-action from 1.10.0 to 1.11.0 dependabot[bot] 2024-12-16 16:02:50 +00:00
  • a312f2e95c
    chore(deps): bump cloud.google.com/go/storage from 1.45.0 to 1.48.0 dependabot[bot] 2024-12-16 15:54:55 +00:00
  • 09831c66d1
    chore(deps): bump github.com/schollz/progressbar/v3 dependabot[bot] 2024-12-16 15:54:40 +00:00
  • 3bb9101700
    chore(deps): bump go.mongodb.org/mongo-driver from 1.16.0 to 1.17.1 dependabot[bot] 2024-12-16 15:54:35 +00:00
  • 3b45a21c93
    chore(deps): bump github.com/getsentry/sentry-go from 0.29.1 to 0.30.0 dependabot[bot] 2024-12-16 15:54:28 +00:00
  • 9f71f49480
    chore(deps): bump github.com/fclairamb/ftpserverlib dependabot[bot] 2024-12-16 15:54:24 +00:00
  • 6454cd05ad feat: metaCache ttl zemul 2024-12-16 16:39:05 +08:00
  • c531e2eb0e
    Update disk_location_ec.go (#6359) coffeecloudgit 2024-12-16 14:05:47 +08:00
  • 7eb8257126
    Update store.go (#6358) coffeecloudgit 2024-12-16 14:05:22 +08:00
  • ce7db9f7eb
    Update disk_location_ec.go coffeecloudgit 2024-12-16 11:49:53 +08:00
  • 65ded174e9
    Update store.go coffeecloudgit 2024-12-16 11:48:07 +08:00
  • 47a2008209
    Update store.go coffeecloudgit 2024-12-16 10:10:04 +08:00
  • 9b48ce0613
    Parallelize EC shards balancing within racks (#6354) Lisandro Pin 2024-12-15 22:36:23 +01:00
  • 4c65c578db Parallelize EC shards balancing within racks. Lisandro Pin 2024-12-13 16:52:54 +01:00
  • 926cfea3dc
    Parallelize EC shards balancing across racks. (#6352) Lisandro Pin 2024-12-13 15:05:32 +01:00
  • d97ffc3bfb Parallelize EC shards balancing across racks. Lisandro Pin 2024-12-13 14:38:49 +01:00
  • b81def5e5c
    Parallelize EC balancing for racks. (#6351) Lisandro Pin 2024-12-13 14:33:53 +01:00
  • d6f3e1970d
    fix: filer may crash by bucketLastActiveTsNs concurrency access. (#6350) zouyixiong 2024-12-13 21:30:21 +08:00
  • c25ed98665 Fix EC concurrency bug introduced by 1f736ce9. Lisandro Pin 2024-12-13 12:21:11 +01:00
  • f33f53c100 Parallelize EC balancing for racks. Lisandro Pin 2024-12-13 12:02:51 +01:00
  • 1f736ce9c1 Collect, and return, all errors on concurrent tasks for shell.EcBalance(). Lisandro Pin 2024-12-13 10:54:52 +01:00
  • 0f3a1e7333
    Merge branch 'seaweedfs:master' into master zouyixiong 2024-12-13 17:31:22 +08:00
  • d452a7ef2e fix: make bucketLastActiveTsNs concurrency write save by sync.Mutex XYZ 2024-12-13 17:16:34 +08:00
  • 0a4b1909a2
    [shell] only apply the balancing for writable volumes (#6346) Konstantin Lebedev 2024-12-13 11:10:00 +02:00
  • e0c588aaa4 fix test balance Konstantin Lebedev 2024-12-13 10:49:39 +02:00
  • 9987a65e8a
    fix: record and delete bucket metrics after inactive (#6349) zouyixiong 2024-12-13 12:34:02 +08:00
  • bd4b405d8f feat: use nao ts XYZ 2024-12-13 12:22:02 +08:00
  • c33cd90d2b fix: record and delete bucket metrics after inactive XYZ 2024-12-13 11:13:32 +08:00
  • b0210df081
    Begin implementing EC balancing parallelization support. (#6342) Lisandro Pin 2024-12-12 18:14:44 +01:00
  • 651650a1be Delete stray TODO. Lisandro Pin 2024-12-12 18:13:30 +01:00
  • 676fddbeb7 Fix whitespace after Gitlab automerge. Lisandro Pin 2024-12-12 18:07:38 +01:00
  • e92568f393
    Merge branch 'master' into ec_topology/rebalance Lisandro Pin 2024-12-12 17:48:42 +01:00
  • 23ffbb083c
    Limit EC re-balancing for ec.encode to relevant collections when a volume ID argument is provided. (#6347) Lisandro Pin 2024-12-12 17:41:33 +01:00
  • 2c9c145aa3 Limit EC re-balancing for ec.encode to relevant collections when a volume ID is provided. Lisandro Pin 2024-12-12 17:05:27 +01:00
  • 6320036c56
    Delete legacy balancing code for ec.encode. (#6344) Lisandro Pin 2024-12-12 16:42:03 +01:00
  • ab1ab16ed9 only apply the balancing for writable volumes Konstantin Lebedev 2024-12-12 17:29:25 +02:00
  • 797376ed47 Fix concurrency bug. Lisandro Pin 2024-12-12 15:29:57 +01:00
  • 4913b0a2c0 Nit: unify naming for ecBalancer wait group methods with the rest of the module. Lisandro Pin 2024-12-12 15:28:43 +01:00
  • f9b8bb998a Make the goroutine workgroup handler for EcBalance() a bit smarter/error-proof. Lisandro Pin 2024-12-12 12:51:08 +01:00
  • a7f53b8105 Delete legacy balancing code for ec.encode. Lisandro Pin 2024-12-12 11:53:52 +01:00
  • 6e4a217019 Nit: improve type naming. Lisandro Pin 2024-12-11 19:49:07 +01:00
  • d1aa6774d9 Begin implementing EC balancing parallelization support. Lisandro Pin 2024-12-11 19:42:32 +01:00
  • 700b95304b
    [shell] volume.list show only writable volumes (#6338) Konstantin Lebedev 2024-12-11 19:06:15 +02:00
  • c37281735e
    volume.list avoid output empty data center and rack and disk info (#6341) Konstantin Lebedev 2024-12-11 19:03:16 +02:00
  • 966076f4d4 volume.list avoid output empty data center and rack and disk info Konstantin Lebedev 2024-12-11 16:55:15 +02:00
  • 7a90f0e6e1 fix import Konstantin Lebedev 2024-12-11 15:03:04 +02:00
  • 860ae02ef8 show only writable volumes Konstantin Lebedev 2024-12-11 15:02:11 +02:00
  • 8c82c037b9
    Unify the re-balancing logic for ec.encode with ec.balance. (#6339) Lisandro Pin 2024-12-10 22:30:13 +01:00
  • c73ac9b78c Unify the re-balancing logic for ec.encode with ec.balance. Lisandro Pin 2024-12-10 18:48:35 +01:00
  • ff1392f7f4
    [shell] use constant for hdd of type (#6337) Konstantin Lebedev 2024-12-10 18:43:59 +02:00
  • ada941a88b use constant for hdd of type Konstantin Lebedev 2024-12-10 17:05:37 +02:00
  • 4f6c989309
    chore(deps): bump golang.org/x/net from 0.31.0 to 0.32.0 (#6330) dependabot[bot] 2024-12-09 09:59:05 -08:00
  • a36da40272
    chore(deps): bump golang.org/x/net from 0.31.0 to 0.32.0 dependabot[bot] 2024-12-09 17:07:15 +00:00
  • af4c51aee6
    chore(deps): bump cloud.google.com/go/pubsub from 1.45.1 to 1.45.3 (#6328) dependabot[bot] 2024-12-09 09:04:45 -08:00
  • a1efaa742a
    chore(deps): bump cloud.google.com/go/pubsub from 1.45.1 to 1.45.3 dependabot[bot] 2024-12-09 16:47:08 +00:00
  • 3cd2f06279
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 from 1.69.0 to 1.71.0 (#6329) dependabot[bot] 2024-12-09 08:46:16 -08:00
  • e438fdc16c
    chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.7.1 to 2.7.2 (#6331) dependabot[bot] 2024-12-09 08:46:00 -08:00
  • 3680bbac56
    chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 (#6332) dependabot[bot] 2024-12-09 08:45:26 -08:00
  • 67461ccd27
    chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 (#6333) dependabot[bot] 2024-12-09 08:45:13 -08:00
  • f0b2070d9b
    chore(deps): bump docker/build-push-action from 6.9.0 to 6.10.0 dependabot[bot] 2024-12-09 16:08:40 +00:00
  • bfe673d71d
    chore(deps): bump golang.org/x/sys from 0.27.0 to 0.28.0 dependabot[bot] 2024-12-09 15:18:24 +00:00
  • 63eebd9a46
    chore(deps): bump github.com/hanwen/go-fuse/v2 from 2.7.1 to 2.7.2 dependabot[bot] 2024-12-09 15:18:21 +00:00
  • adb96ca25d
    chore(deps): bump github.com/aws/aws-sdk-go-v2/service/s3 dependabot[bot] 2024-12-09 15:18:10 +00:00
  • 522a25790a
    Remove average constraints when selecting nodes/racks to balance EC shards into. (#6325) Lisandro Pin 2024-12-06 18:00:06 +01:00
  • 25c643da68 Remove average constraints when selecting nodes/racks to balance EC shards into. Lisandro Pin 2024-12-06 16:15:07 +01:00
  • 914ff0e718
    Replaced https.client.enabled with false in scaffold/security (#6320) vadimartynov 2024-12-05 21:39:28 +03:00
  • dc3af02104 Updated the https.client.enabled option by default in scaffold/security vadimartynov 2024-12-05 21:08:35 +03:00
  • f3dde99796 adjust error message chrislu 2024-12-05 09:33:49 -08:00
  • 34cdbdd279
    Share common parameters for EC re-balancing functions under a single struct. (#6319) Lisandro Pin 2024-12-05 18:00:46 +01:00
  • 8df1a02770 Share common parameters for EC re-balancing functions under a single struct. Lisandro Pin 2024-12-05 16:24:10 +01:00
  • edef485333
    Account for replication placement settings when balancing EC shards within the same rack. (#6317) Lisandro Pin 2024-12-04 19:47:51 +01:00
  • 81096effff Add a few more representative test cases for pickEcNodeToBalanceShardsInto(). Lisandro Pin 2024-12-04 18:42:16 +01:00