a3f00c5d5e
batch: Strict unmarshal yaml document to avoid user made typos ( #17808 )
...
// UnmarshalStrict is like Unmarshal except that any fields that are found
// in the data that do not have corresponding struct members, or mapping
// keys that are duplicates, will result in
// an error.
2023-08-05 13:51:48 -07:00
26c23b30f4
replication: set context timeout for NewMultipartUpload calls ( #17807 )
2023-08-05 12:27:07 -07:00
a436fd513b
track client disconnections properly for all ListObjects calls ( #17804 )
...
Currently ListObjects* calls were returning 200 OK for timed-out clients,
this makes debugging via `mc admin trace` very hard.
2023-08-04 15:57:27 -07:00
3bc34ffd94
Update yaml files to latest version RELEASE.2023-08-04T17-40-21Z
2023-08-04 19:12:46 +00:00
533cd8d6df
fix: batch replication pull must preserve versionID ( #17805 )
...
batch replication pull must preserve versionID regardless
of destination bucket versioning configuration.
This is similar to the issue with decommissioning and rebalancing
2023-08-04 12:09:10 -07:00
cb089dcb52
error out by default beyond 10000 versions per object ( #17803 )
...
```
You've exceeded the limit on the number of versions you can create on this object
```
2023-08-04 10:40:21 -07:00
e0329cfdbb
update console v0.35.1
2023-08-03 20:25:21 -07:00
239ccc9c40
fix: crash in globalTierJournal when TierConfig is not initialized ( #17791 )
2023-08-03 14:16:15 -07:00
b762fbaf21
sts: validate if iam subsystem initialized in handlers ( #17796 )
2023-08-03 13:24:25 -07:00
0285df5a02
fix: prioritize audit_webhook and logger_webhook ENVs over the config KVS ( #17783 )
2023-08-03 02:47:07 -07:00
45fb375c41
allow healing to prefer local disks over remote ( #17788 )
2023-08-03 02:18:18 -07:00
4a4950fe41
fix: honor requested allow origin settings properly ( #17789 )
...
fixes #17778
2023-08-02 20:41:21 -07:00
1664fd8bb1
Avoid logging errors twice during transitioned objects expiration ( #17782 )
2023-08-02 09:06:03 -07:00
21cdd2bf5d
avoid overwriting metrics on success, save it in defer ( #17780 )
2023-08-01 22:19:56 -07:00
0153f96a20
add deadlines for readMetadata() in listing ( #17776 )
...
Bonus: also skip spending time looking for xl.json
- Listing()
- Delete()
2023-08-01 21:52:31 -07:00
a7a7533190
add new errors for Disks with timeouts ( #17770 )
2023-08-01 12:47:50 -07:00
311380f8cb
replication resync: fix queueing ( #17775 )
...
Assign resync of all versions of object to the same worker to avoid locking
contention. Fixes parallel resync implementation in #16707
2023-08-01 11:51:15 -07:00
b0f0e53bba
fix: make sure to correctly initialize health checks ( #17765 )
...
health checks were missing for drives replaced since
- HealFormat() would replace the drives without a health check
- disconnected drives when they reconnect via connectEndpoint()
the loop also loses health checks for local disks and merges
these into a single code.
- other than this separate cleanUp, health check variables to avoid
overloading them with similar requirements.
- also ensure that we compete via context selector for disk monitoring
such that the canceled disks don't linger around longer waiting for
the ticker to trigger.
- allow disabling active monitoring.
2023-08-01 10:54:26 -07:00
004f1e2f66
Fix trailing header signature mismatch ( #17774 )
...
Seems like clients may omit a newline at the end of the trailer chunk. Each header should end with a newline. Add that if missing.
Fixes #17662
2023-08-01 08:45:57 -07:00
2fa561f22e
do not crash on invalid metric values ( #17764 )
...
```
minio[1032735]: panic: label value "\xc0.\xc0." is not valid UTF-8
minio[1032735]: goroutine 1781101 [running]:
minio[1032735]: github.com/prometheus/client_golang/prometheus.MustNewConstMetric(...)
```
log such errors for investigation
2023-08-01 00:55:39 -07:00
81be718674
fix: optimize DiskInfo() call avoid metrics when not needed ( #17763 )
2023-07-31 15:20:48 -07:00
8162fd1e20
fix: couple of typos in README.md ( #17754 )
2023-07-31 11:17:13 -07:00
49a1e2f98e
update-notifier.go: misleading version age message ( #17750 )
2023-07-31 08:36:19 -07:00
684c46369c
Send events for extracted objects ( #17760 )
...
Fixes #17759
2023-07-31 08:33:51 -07:00
715c9e3ca9
fix: allow mc executable inside minio containers ( #17755 )
2023-07-31 00:13:41 -07:00
73edd5b8fd
introduce 'mc admin config set alias/ api odirect=on' ( #17753 )
...
change disable_odirect=off -> odirect=on to make it
easier to understand, instead of making it double
negative.
2023-07-31 00:12:53 -07:00
5e5bdf5432
capture total errors data availability and any timeout errors ( #17748 )
2023-07-29 23:26:26 -07:00
48a3e9bc82
update NTP package to fix ipv6 bug ( #17752 )
2023-07-29 17:43:50 -07:00
f13cfcb83e
allow disabling O_DIRECT for write ops ( #17751 )
...
on really slow systems, O_DIRECT simply kills the drives
allow for a way to disable them.
2023-07-29 15:17:56 -07:00
9c0e8cd15b
logger: Avoid slow calls in http logger Send() function ( #17747 )
...
Send() is synchronous and can affect the latency of S3 requests when the
logger buffer is full.
Avoid checking if the HTTP target is online or not and increase the
workers anyway since the buffer is already full.
Also, avoid logs flooding when the audit target is down.
2023-07-29 12:49:18 -07:00
ad2a70ba06
update console v0.34.0
...
Signed-off-by: Harshavardhana <harsha@minio.io >
2023-07-28 17:24:05 -07:00
731e03fe5a
add ReadFileStream deadline for disk call ( #17745 )
...
timeout the reader side if hung via disk max timeout
2023-07-28 15:37:53 -07:00
f9d029c8fa
fix: prevCertificate save not correct in loop ( #17744 )
...
fix certs save not correct
Co-authored-by: guozhi.li <guozhi.li@daocloud.io >
2023-07-28 12:57:49 -07:00
7057d00a28
s3: Return invalid bucket name the first thing in all S3 calls ( #17742 )
2023-07-28 10:49:20 -07:00
114fab4c70
export cluster health as prometheus metrics ( #17741 )
2023-07-28 01:16:53 -07:00
c2edbfae55
update all deps and add credits ( #17740 )
2023-07-27 12:43:25 -07:00
a92cb66468
Get the signed headers in the order they were signed ( #17690 )
...
use pSignValues to get signed headers in order
2023-07-27 11:45:30 -07:00
535f97ba61
check if metadata headers/url values are equal with signed headers ( #17737 )
2023-07-27 11:44:56 -07:00
14ebd82dbd
fix: missing disk metrics when query metric api from peer ( #17738 )
2023-07-27 11:44:13 -07:00
aea7b08a47
Update nats server dependency ( #17734 )
...
I don't see why we shouldn't.
Fixes #17730
2023-07-27 07:35:52 -07:00
47dcfcbdd4
introduce deadlines on READ operations ( #17724 )
2023-07-27 07:33:05 -07:00
bf3901342c
Include SuccessorModTime for FileInfo quorum ( #17732 )
2023-07-26 17:04:16 -07:00
e1731d9403
Added bucket specific grafana dashboard ( #17727 )
...
Signed-off-by: Shubhendu Ram Tripathi <shubhendu@minio.io >
2023-07-26 15:10:11 -07:00
b28bcad11b
avoid Access() calls on known bucket paths ( #17719 )
2023-07-26 11:31:40 -07:00
a7c71e4c6b
protect disk monitoring to avoid busy loop configuration ( #17723 )
2023-07-25 20:02:22 -07:00
1a42693d68
replication: limit larger uploads to a subset of workers ( #17687 )
...
Limit large uploads (> 128MiB) to a max of 10 workers, intent is to avoid
larger uploads from using all replication bandwidth, giving room for smaller
uploads to sync faster.
2023-07-25 20:02:02 -07:00
e7b60c4d65
Add slow drive timeouts to match with active disk monitoring ( #17701 )
...
allow active disk-monitoring to be configurable, and use
these add deadlines in various call layers for various
syscalls.
2023-07-25 16:58:31 -07:00
f95129894d
Use decrypted object size while computing object size summary ( #17717 )
...
Corrects an issue with encrypted versioned objects being reported under
`unversioned` bin in the object version histogram
2023-07-24 17:13:25 -07:00
c32c71c836
allow DNS cache TTL to be configurable ( #17709 )
...
this is added for now as a hidden variable
2023-07-24 15:13:35 -07:00
14e1ace552
remove serializing WalkDir() across all buckets/prefixes on SSDs ( #17707 )
...
slower drives get knocked off because they are too slow via
active monitoring, we do not need to block calls arbitrarily.
Serializing adds latencies for already slow calls, remove
it for SSDs/NVMEs
Also, add a selection with context when writing to `out <-`
channel, to avoid any potential blocks.
2023-07-24 09:30:19 -07:00
Anis Eleuch