FRINK Linked Data Fragments server

Matches in SemOpenAlex for { <https://semopenalex.org/work/W3184997675> ?p ?o ?g. }

• W3184997675 abstract "Machine learning (ML) prediction APIs are increasingly widely used. An ML API can change over time due to model updates or retraining. This presents a key challenge in the usage of the API because it is often not clear to the user if and how the ML model has changed. Model shifts can affect downstream application performance and also create oversight issues (e.g. if consistency is desired). In this paper, we initiate a systematic investigation of ML API shifts. We first quantify the performance shifts from 2020 to 2021 of popular ML APIs from Google, Microsoft, Amazon, and others on a variety of datasets. We identified significant model shifts in 12 out of 36 cases we investigated. Interestingly, we found several datasets where the API's predictions became significantly worse over time. This motivated us to formulate the API shift assessment problem at a more fine-grained level as estimating how the API model's confusion matrix changes over time when the data distribution is constant. Monitoring confusion matrix shifts using standard random sampling can require a large number of samples, which is expensive as each API call costs a fee. We propose a principled adaptive sampling algorithm, MASA, to efficiently estimate confusion matrix shifts. MASA can accurately estimate the confusion matrix shifts in commercial ML APIs using up to 90% fewer samples compared to random sampling. This work establishes ML API shifts as an important problem to study and provides a cost-effective approach to monitor such shifts." @default.
• W3184997675 created "2021-08-02" @default.
• W3184997675 creator A5003134390 @default.
• W3184997675 creator A5005554337 @default.
• W3184997675 creator A5005779176 @default.
• W3184997675 creator A5088047533 @default.
• W3184997675 date "2021-07-29" @default.
• W3184997675 modified "2023-10-04" @default.
• W3184997675 title "Did the Model Change? Efficiently Assessing Machine Learning API Shifts." @default.
• W3184997675 cites W2009636294 @default.
• W3184997675 cites W2034368206 @default.
• W3184997675 cites W2041616772 @default.
• W3184997675 cites W2103851188 @default.
• W3184997675 cites W2113459411 @default.
• W3184997675 cites W2141253686 @default.
• W3184997675 cites W2152029707 @default.
• W3184997675 cites W2165419534 @default.
• W3184997675 cites W2182034283 @default.
• W3184997675 cites W2206328504 @default.
• W3184997675 cites W227597898 @default.
• W3184997675 cites W2738672149 @default.
• W3184997675 cites W2788481061 @default.
• W3184997675 cites W2797583228 @default.
• W3184997675 cites W2799736974 @default.
• W3184997675 cites W2872172641 @default.
• W3184997675 cites W2910300272 @default.
• W3184997675 cites W2918408501 @default.
• W3184997675 cites W2948734064 @default.
• W3184997675 cites W2962739340 @default.
• W3184997675 cites W2972584841 @default.
• W3184997675 cites W3012756311 @default.
• W3184997675 cites W3026649487 @default.
• W3184997675 cites W3035507081 @default.
• W3184997675 cites W3037887271 @default.
• W3184997675 cites W3103146244 @default.
• W3184997675 cites W3112486745 @default.
• W3184997675 cites W3112629945 @default.
• W3184997675 hasPublicationYear "2021" @default.
• W3184997675 type Work @default.
• W3184997675 sameAs 3184997675 @default.
• W3184997675 citedByCount "1" @default.
• W3184997675 countsByYear W31849976752021 @default.
• W3184997675 crossrefType "posted-content" @default.
• W3184997675 hasAuthorship W3184997675A5003134390 @default.
• W3184997675 hasAuthorship W3184997675A5005554337 @default.
• W3184997675 hasAuthorship W3184997675A5005779176 @default.
• W3184997675 hasAuthorship W3184997675A5088047533 @default.
• W3184997675 hasConcept C106131492 @default.
• W3184997675 hasConcept C11171543 @default.
• W3184997675 hasConcept C111919701 @default.
• W3184997675 hasConcept C119857082 @default.
• W3184997675 hasConcept C124101348 @default.
• W3184997675 hasConcept C138602881 @default.
• W3184997675 hasConcept C140779682 @default.
• W3184997675 hasConcept C154945302 @default.
• W3184997675 hasConcept C15744967 @default.
• W3184997675 hasConcept C26517878 @default.
• W3184997675 hasConcept C2776436953 @default.
• W3184997675 hasConcept C2781140086 @default.
• W3184997675 hasConcept C31972630 @default.
• W3184997675 hasConcept C41008148 @default.
• W3184997675 hasConceptScore W3184997675C106131492 @default.
• W3184997675 hasConceptScore W3184997675C11171543 @default.
• W3184997675 hasConceptScore W3184997675C111919701 @default.
• W3184997675 hasConceptScore W3184997675C119857082 @default.
• W3184997675 hasConceptScore W3184997675C124101348 @default.
• W3184997675 hasConceptScore W3184997675C138602881 @default.
• W3184997675 hasConceptScore W3184997675C140779682 @default.
• W3184997675 hasConceptScore W3184997675C154945302 @default.
• W3184997675 hasConceptScore W3184997675C15744967 @default.
• W3184997675 hasConceptScore W3184997675C26517878 @default.
• W3184997675 hasConceptScore W3184997675C2776436953 @default.
• W3184997675 hasConceptScore W3184997675C2781140086 @default.
• W3184997675 hasConceptScore W3184997675C31972630 @default.
• W3184997675 hasConceptScore W3184997675C41008148 @default.
• W3184997675 hasLocation W31849976751 @default.
• W3184997675 hasOpenAccess W3184997675 @default.
• W3184997675 hasPrimaryLocation W31849976751 @default.
• W3184997675 hasRelatedWork W1486455500 @default.
• W3184997675 hasRelatedWork W1989361423 @default.
• W3184997675 hasRelatedWork W2065280033 @default.
• W3184997675 hasRelatedWork W2136987366 @default.
• W3184997675 hasRelatedWork W2161849439 @default.
• W3184997675 hasRelatedWork W2293019624 @default.
• W3184997675 hasRelatedWork W2345102896 @default.
• W3184997675 hasRelatedWork W2402007731 @default.
• W3184997675 hasRelatedWork W2550966576 @default.
• W3184997675 hasRelatedWork W2765978922 @default.
• W3184997675 hasRelatedWork W2809055754 @default.
• W3184997675 hasRelatedWork W2810058851 @default.
• W3184997675 hasRelatedWork W2894703070 @default.
• W3184997675 hasRelatedWork W2907682998 @default.
• W3184997675 hasRelatedWork W2921938997 @default.
• W3184997675 hasRelatedWork W3003639946 @default.
• W3184997675 hasRelatedWork W3081193447 @default.
• W3184997675 hasRelatedWork W3081467912 @default.
• W3184997675 hasRelatedWork W3129603732 @default.
• W3184997675 hasRelatedWork W3176782109 @default.
• W3184997675 isParatext "false" @default.
• W3184997675 isRetracted "false" @default.

• next