Matches in SemOpenAlex for { <https://semopenalex.org/work/W159656292> ?p ?o ?g. }
Showing items 1 to 85 of
85
with 100 items per page.
- W159656292 abstract "We propose a novel stochastic gradient method---semi-stochastic coordinate descent (S2CD)---for the problem of minimizing a strongly convex function represented as the average of a large number of smooth convex functions: $f(x)=tfrac{1}{n}sum_i f_i(x)$. Our method first performs a deterministic step (computation of the gradient of $f$ at the starting point), followed by a large number of stochastic steps. The process is repeated a few times, with the last stochastic iterate becoming the new starting point where the deterministic step is taken. The novelty of our method is in how the stochastic steps are performed. In each such step, we pick a random function $f_i$ and a random coordinate $j$---both using nonuniform distributions---and update a single coordinate of the decision vector only, based on the computation of the $j^{th}$ partial derivative of $f_i$ at two different points. Each random step of the method constitutes an unbiased estimate of the gradient of $f$ and moreover, the squared norm of the steps goes to zero in expectation, meaning that the stochastic estimate of the gradient progressively improves. The complexity of the method is the sum of two terms: $O(nlog(1/epsilon))$ evaluations of gradients $nabla f_i$ and $O(hat{kappa}log(1/epsilon))$ evaluations of partial derivatives $nabla_j f_i$, where $hat{kappa}$ is a novel condition number." @default.
- W159656292 created "2016-06-24" @default.
- W159656292 creator A5036598221 @default.
- W159656292 creator A5044349979 @default.
- W159656292 creator A5048916516 @default.
- W159656292 date "2014-12-19" @default.
- W159656292 modified "2023-10-01" @default.
- W159656292 title "Semi-Stochastic Coordinate Descent" @default.
- W159656292 hasPublicationYear "2014" @default.
- W159656292 type Work @default.
- W159656292 sameAs 159656292 @default.
- W159656292 citedByCount "8" @default.
- W159656292 countsByYear W1596562922015 @default.
- W159656292 countsByYear W1596562922016 @default.
- W159656292 countsByYear W1596562922017 @default.
- W159656292 countsByYear W1596562922018 @default.
- W159656292 crossrefType "posted-content" @default.
- W159656292 hasAuthorship W159656292A5036598221 @default.
- W159656292 hasAuthorship W159656292A5044349979 @default.
- W159656292 hasAuthorship W159656292A5048916516 @default.
- W159656292 hasConcept C105795698 @default.
- W159656292 hasConcept C112680207 @default.
- W159656292 hasConcept C114614502 @default.
- W159656292 hasConcept C118615104 @default.
- W159656292 hasConcept C119857082 @default.
- W159656292 hasConcept C121332964 @default.
- W159656292 hasConcept C122123141 @default.
- W159656292 hasConcept C145446738 @default.
- W159656292 hasConcept C153258448 @default.
- W159656292 hasConcept C206688291 @default.
- W159656292 hasConcept C2524010 @default.
- W159656292 hasConcept C2779557605 @default.
- W159656292 hasConcept C28826006 @default.
- W159656292 hasConcept C33923547 @default.
- W159656292 hasConcept C41008148 @default.
- W159656292 hasConcept C50644808 @default.
- W159656292 hasConcept C54207081 @default.
- W159656292 hasConcept C62520636 @default.
- W159656292 hasConcept C8272713 @default.
- W159656292 hasConceptScore W159656292C105795698 @default.
- W159656292 hasConceptScore W159656292C112680207 @default.
- W159656292 hasConceptScore W159656292C114614502 @default.
- W159656292 hasConceptScore W159656292C118615104 @default.
- W159656292 hasConceptScore W159656292C119857082 @default.
- W159656292 hasConceptScore W159656292C121332964 @default.
- W159656292 hasConceptScore W159656292C122123141 @default.
- W159656292 hasConceptScore W159656292C145446738 @default.
- W159656292 hasConceptScore W159656292C153258448 @default.
- W159656292 hasConceptScore W159656292C206688291 @default.
- W159656292 hasConceptScore W159656292C2524010 @default.
- W159656292 hasConceptScore W159656292C2779557605 @default.
- W159656292 hasConceptScore W159656292C28826006 @default.
- W159656292 hasConceptScore W159656292C33923547 @default.
- W159656292 hasConceptScore W159656292C41008148 @default.
- W159656292 hasConceptScore W159656292C50644808 @default.
- W159656292 hasConceptScore W159656292C54207081 @default.
- W159656292 hasConceptScore W159656292C62520636 @default.
- W159656292 hasConceptScore W159656292C8272713 @default.
- W159656292 hasLocation W1596562921 @default.
- W159656292 hasOpenAccess W159656292 @default.
- W159656292 hasPrimaryLocation W1596562921 @default.
- W159656292 hasRelatedWork W1523661875 @default.
- W159656292 hasRelatedWork W2047152541 @default.
- W159656292 hasRelatedWork W2062889068 @default.
- W159656292 hasRelatedWork W2095984592 @default.
- W159656292 hasRelatedWork W2103628399 @default.
- W159656292 hasRelatedWork W2107438106 @default.
- W159656292 hasRelatedWork W2117686388 @default.
- W159656292 hasRelatedWork W2164075197 @default.
- W159656292 hasRelatedWork W2274932606 @default.
- W159656292 hasRelatedWork W2467074172 @default.
- W159656292 hasRelatedWork W2806105434 @default.
- W159656292 hasRelatedWork W2889576094 @default.
- W159656292 hasRelatedWork W2903893215 @default.
- W159656292 hasRelatedWork W2912297034 @default.
- W159656292 hasRelatedWork W2937221077 @default.
- W159656292 hasRelatedWork W2946943162 @default.
- W159656292 hasRelatedWork W2972843681 @default.
- W159656292 hasRelatedWork W3024230214 @default.
- W159656292 hasRelatedWork W3141595720 @default.
- W159656292 hasRelatedWork W3018264074 @default.
- W159656292 isParatext "false" @default.
- W159656292 isRetracted "false" @default.
- W159656292 magId "159656292" @default.
- W159656292 workType "article" @default.